Sep 04 05:48:22 devstack cinder-volume[76207]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 05:48:22 devstack cinder-volume[76207]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 05:48:22 devstack cinder-volume[76207]: we strongly recommend against using it for new projects.
Sep 04 05:48:22 devstack cinder-volume[76207]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 05:48:22 devstack cinder-volume[76207]: framework.  For more detail see
Sep 04 05:48:22 devstack cinder-volume[76207]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 05:48:22 devstack cinder-volume[76207]:   import eventlet  # noqa
Sep 04 05:48:24 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:48:24 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:48:24 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:48:26 devstack cinder-volume[76207]: INFO dbcounter [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Registered counter for database cinder
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG oslo_db.sqlalchemy.engines [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writer thread running {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:48:26 devstack cinder-volume[76207]: INFO cinder.rpc [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 05:48:26 devstack cinder-volume[76207]: INFO cinder.rpc [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG oslo_db.sqlalchemy.engines [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:48:26 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Determined volume DB was empty at startup.
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG cinder.volume.manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76207) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 05:48:26 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 04 05:48:26 devstack cinder-volume[76207]: WARNING stevedore.named [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 05:48:26 devstack cinder-volume[76207]: WARNING castellan.key_manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:48:26 devstack cinder-volume[76207]: WARNING cinder.keymgr.conf_key_mgr [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG cinder.volume.drivers.lvm [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76207) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Sep 04 05:48:26 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_concurrency.processutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] CMD "cinder-rtstool verify" returned: 0 in 0.455s {{(pid=76207) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_db.sqlalchemy.engines [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:48:27 devstack cinder-volume[76207]: INFO cinder.rpc [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 04 05:48:27 devstack cinder-volume[76207]: INFO cinder.rpc [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 04 05:48:27 devstack cinder-volume[76207]: WARNING stevedore.named [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 05:48:27 devstack cinder-volume[76207]: WARNING castellan.key_manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:48:27 devstack cinder-volume[76207]: INFO cinder.volume.manager [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_db.sqlalchemy.engines [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:48:27 devstack cinder-volume[76207]: INFO oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Starting 1 workers
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Started child 76365 {{(pid=76207) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Full set of CONF: {{(pid=76207) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] ******************************************************************************** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 05:48:27 devstack cinder-volume[76365]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Configuration options gathered from: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] ================================================================================ {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] allow_availability_zone_fallback = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] allow_compression_on_image_upload = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] allowed_direct_url_schemes     = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] api_rate_limit                 = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] auth_strategy                  = keystone {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] az_cache_duration              = 3600 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_availability_zone      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_host                   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_name                   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_stats_polling_interval = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backup_api_class               = cinder.backup.api.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backup_name_template           = backup-%s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backup_use_same_host           = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backup_use_temp_snapshot       = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] chap_password                  = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] chap_username                  =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_internal_tenant_project_id = 6d4e73e8eb5d4ec1a03dbc0e1f5d241c {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_internal_tenant_user_id = bb10d0bed7124fa1a39216725111bd29 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cloned_volume_same_az          = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cluster                        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] compression_format             = gzip {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] compute_api_class              = cinder.compute.nova.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] config_dir                     = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] config_source                  = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] control_exchange               = openstack {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] debug                          = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] default_availability_zone      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] default_group_type             = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] default_volume_type            = lvmdriver-1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] disk_geometry                  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_client_cert             = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_client_cert_key         = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_data_namespace          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_ssl_cert_path           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_ssl_cert_verify         = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] driver_use_ssl                 = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] enable_force_upload            = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] enable_new_services            = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] enable_unsupported_driver      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] enforce_multipath_for_image_xfer = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] filter_function                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_api_insecure            = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_api_servers             = ['http://192.168.122.39/image'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_api_ssl_compression     = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_ca_certificates_file    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_catalog_info            = image:glance:publicURL {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_certfile                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_keyfile                 = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_num_retries             = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance_request_timeout         = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] goodness_function              = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] graceful_shutdown_timeout      = 5 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] group_api_class                = cinder.group.api.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] host                           = devstack {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_compress_on_upload       = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_conversion_address_space_limit = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_conversion_cpu_limit     = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_conversion_disable       = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_upload_use_cinder_backend = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_upload_use_internal_tenant = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_volume_cache_enabled     = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_volume_cache_max_count   = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] image_volume_cache_max_size_gb = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] init_host_max_objects_retrieval = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] instance_format                = [instance: %(uuid)s]  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: INFO cinder.volume.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iscsi_target_flags             =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iscsi_write_cache              = on {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iser_helper                    = tgtadm {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iser_ip_address                = 192.168.122.39 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iser_port                      = 3260 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_color                      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_config_append              = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_dir                        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_file                       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_options                    = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_rotate_interval            = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_rotate_interval_type       = days {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] log_rotation_type              = none {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] max_age                        = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] max_logfile_count              = 30 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] max_logfile_size_mb            = 200 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] max_over_subscription_ratio    = 20.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] message_reap_interval          = 86400 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] message_ttl                    = 2592000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] migration_create_volume_timeout_secs = 300 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] monkey_patch                   = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] monkey_patch_modules           = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] my_ip                          = 192.168.122.39 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] no_snapshot_gb_quota           = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] num_iser_scan_tries            = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] num_shell_tries                = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] num_volume_device_scan_tries   = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] nvmeof_conn_info_version       = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] nvmet_ns_id                    = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] nvmet_port_id                  = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_max_limit                = 1000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_ext_list          = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_listen_port       = 8776 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_use_ssl           = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] osapi_volume_workers           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] per_volume_size_limit          = -1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] periodic_fuzzy_delay           = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] periodic_interval              = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] public_endpoint                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] publish_errors                 = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_backup_gigabytes         = 1000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_backups                  = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_gigabytes                = 1000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_groups                   = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_snapshots                = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] quota_volumes                  = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] rate_limit_burst               = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] rate_limit_except_level        = CRITICAL {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] rate_limit_interval            = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] reinit_driver_count            = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] replication_device             = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] report_discard_supported       = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] report_interval                = 120 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] reservation_clean_interval     = 86400 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] reservation_expire             = 86400 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] reserved_image_namespaces      = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] reserved_percentage            = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] rpc_response_timeout           = 120 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] run_external_periodic_tasks    = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] scst_target_driver             = iscsi {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] scst_target_iqn_name           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_down_time              = 720 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] shell_completion               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] snapshot_name_template         = snapshot-%s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] snapshot_same_host             = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] split_loggers                  = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] state_path                     = /opt/stack/data/cinder {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] storage_availability_zone      = nova {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] storage_protocol               = iSCSI {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] syslog_log_facility            = LOG_USER {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_helper                  = lioadm {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_ip_address              = 192.168.122.39 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_port                    = 3260 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_protocol                = iscsi {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] target_secondary_ip_addresses  = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] trace_flags                    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] transport_url                  = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] until_refresh                  = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_chap_auth                  = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_default_quota_class        = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_journal                    = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_json                       = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_multipath_for_image_xfer   = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_stderr                     = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] use_syslog                     = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] verify_glance_signatures       = enabled {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_api_class               = cinder.volume.api.API {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_backend_name            = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_clear                   = zero {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_clear_ionice            = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_clear_size              = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_copy_bps_limit          = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_dd_blocksize            = 1M {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_name_template           = volume-%s {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_service_inithost_offload = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volume_usage_audit_period      = month {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] zoning_mode                    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_concurrency.disable_process_locking = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.auth_section = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.auth_type   = password {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.auth_version = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.cache       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.certfile    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.include_service_catalog = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.insecure    = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.interface   = public {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.keyfile     = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_password = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcache_username = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.region_name = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.service_type = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.backend                  = dogpile.cache.null {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.backend_argument         = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack sudo[76439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 04 05:48:27 devstack sudo[76439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.backend_expiration_time  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.config_prefix            = cache.oslo {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.debug_cache_backend      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.enable_retry_client      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.enable_socket_keepalive  = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.enabled                  = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.expiration_time          = 600 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.hashclient_retry_attempts = 2 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_dead_retry      = 300 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_pool_maxsize    = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_sasl_enabled    = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.password                 = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.proxies                  = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.redis_db                 = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.redis_server             = localhost:6379 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.retry_attempts           = 2 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.retry_delay              = 0.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.socket_keepalive_count   = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.socket_keepalive_idle    = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.socket_keepalive_interval = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.socket_timeout           = 1.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.tls_allowed_ciphers      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.tls_cafile               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.tls_certfile             = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.tls_enabled              = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.tls_keyfile              = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cache.username                 = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] coordination.backend_url       = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.asyncio_connection    = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.asyncio_slave_connection = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.backend               = sqlalchemy {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.connection            = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.connection_debug      = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.connection_parameters =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.connection_recycle_time = 3600 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.connection_trace      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.db_inc_retry_interval = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.db_max_retries        = 20 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.db_max_retry_interval = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.db_retry_interval     = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.max_overflow          = 50 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.max_pool_size         = 5 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.max_retries           = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.mysql_wsrep_sync_wait = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.pool_timeout          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.retry_interval        = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.slave_connection      = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.sqlite_synchronous    = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.synchronous_reader    = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] database.use_db_reconnect      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_tracing.insecure = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.connection_string     = messaging:// {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.enabled               = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.es_doc_type           = notification {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.es_scroll_size        = 10000 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.es_scroll_time        = 2m {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.filter_error_trace    = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.hmac_keys             = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.sentinel_service_name = mymaster {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.socket_timeout        = 0.1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.trace_requests        = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler.trace_sqlalchemy      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler_jaeger.process_tags   = {} {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler_jaeger.service_name_prefix = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] profiler_otlp.service_name_prefix = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.enforce_new_defaults = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.policy_default_rule = default {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.policy_file        = policy.yaml {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.group          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.helper_command = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] privsep_osbrick.user           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.group         = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.helper_command = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] cinder_sys_admin.user          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.auth_section      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.auth_type         = password {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.cafile            = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.certfile          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.collect_timing    = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.insecure          = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.keyfile           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.send_service_user_token = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.split_loggers     = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.timeout           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.tls_ciphers       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] service_user.tls_min_version   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.auth_section            = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.auth_type               = password {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.certfile                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.collect_timing          = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.insecure                = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.keyfile                 = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.region_name             = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.split_loggers           = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.timeout                 = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.tls_ciphers             = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] glance.tls_min_version         = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.backend_availability_zone = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.chap_password = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.chap_username =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.disk_geometry = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_client_cert = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_client_cert_key = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_data_namespace = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.driver_use_ssl = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.extra_capabilities = {} {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.filter_function = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.goodness_function = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iscsi_target_flags =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iscsi_write_cache = on {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iser_helper   = tgtadm {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iser_port     = 3260 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.lvm_share_target = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.lvm_type      = auto {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.num_shell_tries = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.replication_device = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.report_discard_supported = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.reserved_percentage = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_helper = tgtadm {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_port   = 3260 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_protocol = iscsi {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.trace_flags   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.unique_fqdn_network = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.use_chap_auth = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_backend_name = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_clear  = zero {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_clear_ionice = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_clear_size = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_reports.file_event_handler = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_reports.log_dir           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.backend_host       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.chap_password      = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.chap_username      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.disk_geometry      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_client_cert = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.extra_capabilities = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.filter_function    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.goodness_function  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iser_helper        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iser_ip_address    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iser_port          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.lvm_share_target   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.lvm_type           = auto {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.num_shell_tries    = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.replication_device = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.report_discard_supported = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.reserved_percentage = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.scst_target_driver = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.storage_protocol   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_helper      = lioadm {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_ip_address  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_port        = 3260 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.trace_flags        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.use_chap_auth      = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_clear       = zero {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_clear_size  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] lvmdriver-1.volumes_dir        = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl      = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_notifications.driver = [] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_notifications.retry = -1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] key_manager.fixed_key          = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.barbican_api_version  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.barbican_endpoint     = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.barbican_endpoint_type = public {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.barbican_region_name  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.cafile                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.certfile              = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.collect_timing        = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.insecure              = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.keyfile               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.number_of_retries     = 60 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.retry_delay           = 1 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.send_service_user_token = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.split_loggers         = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.timeout               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.tls_ciphers           = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.tls_min_version       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.verify_ssl            = True {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican.verify_ssl_path       = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.auth_section = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.auth_type = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.cafile   = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.certfile = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.collect_timing = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.insecure = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.keyfile  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.split_loggers = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.timeout  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.tls_ciphers = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] barbican_service_user.tls_min_version = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.approle_role_id          = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.approle_secret_id        = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.auth_method              = approle {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.auth_path                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.kv_mountpoint            = secret {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.kv_path                  = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.kv_version               = 2 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.namespace                = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.root_token_id            = **** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.ssl_ca_crt_file          = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.timeout                  = 60.0 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.token_file               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.token_role               = None {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.use_ssl                  = False {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:48:27 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] ******************************************************************************** {{(pid=76207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 05:48:27 devstack sudo[76439]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.340s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:27 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:27 devstack sudo[76561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:27 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:28 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.249s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 05:48:28 devstack cinder-volume[76365]: INFO cinder.brick.local_dev.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:28 devstack sudo[76655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:28 devstack sudo[76655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:28 devstack sudo[76655]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG cinder.brick.local_dev.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76365) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Sep 04 05:48:28 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:28 devstack sudo[76762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:28 devstack sudo[76762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:29 devstack sudo[76762]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:29 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.540s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:29 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:29 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:29 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:29 devstack sudo[77082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:30 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:30 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:30 devstack sudo[77141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 04 05:48:30 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:30 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.250s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:30 devstack sudo[77144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:30 devstack sudo[77144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:30 devstack sudo[77144]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:30 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:30 devstack sudo[77147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:30 devstack sudo[77147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:31 devstack sudo[77147]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack sudo[77156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:31 devstack sudo[77156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:31 devstack sudo[77156]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack sudo[77159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:31 devstack sudo[77159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:31 devstack sudo[77159]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack sudo[77163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:31 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:31 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: INFO cinder.volume.drivers.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:31 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:31 devstack sudo[77167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:31 devstack sudo[77167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:32 devstack sudo[77167]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:32 devstack sudo[77171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:32 devstack sudo[77171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:32 devstack sudo[77171]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:32 devstack sudo[77175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:32 devstack sudo[77175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:32 devstack sudo[77175]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:32 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:32 devstack sudo[77179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:32 devstack sudo[77179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:33 devstack sudo[77179]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:33 devstack sudo[77182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:33 devstack sudo[77182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:33 devstack sudo[77182]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:33 devstack cinder-volume[76365]: INFO cinder.volume.driver [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG cinder.volume.driver [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76365) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_db.sqlalchemy.engines [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76365) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writer thread running {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG cinder.db.api [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Building query based on filter {{(pid=76365) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG cinder.image.image_utils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76365) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 05:48:33 devstack cinder-volume[76365]: INFO cinder.keymgr.migration [None req-fc34def8-8558-4fb3-9a74-5bee7452fb79 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:33 devstack sudo[77187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:33 devstack sudo[77187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:33 devstack sudo[77187]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:33 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:33 devstack sudo[77190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:33 devstack sudo[77190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:34 devstack sudo[77190]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:34 devstack sudo[77193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:34 devstack sudo[77193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:34 devstack sudo[77193]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:34 devstack sudo[77200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:34 devstack sudo[77200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:34 devstack sudo[77200]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG cinder.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Notifying Schedulers of capabilities ... {{(pid=76365) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:48:34 devstack cinder-volume[76365]: INFO cinder.volume.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Driver initialization completed successfully.
Sep 04 05:48:34 devstack cinder-volume[76365]: INFO cinder.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Initiating service 2 cleanup
Sep 04 05:48:34 devstack cinder-volume[76365]: INFO cinder.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Service 2 cleanup completed.
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG cinder.service [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Creating RPC server for service cinder-volume {{(pid=76365) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG cinder.service [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76365) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 05:48:34 devstack cinder-volume[76365]: INFO cinder.volume.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:48:34 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:34 devstack sudo[77203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:48:34 devstack sudo[77203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:35 devstack sudo[77203]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:35 devstack sudo[77206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:35 devstack sudo[77206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:35 devstack sudo[77206]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:35 devstack sudo[77215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:48:35 devstack sudo[77215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:35 devstack sudo[77215]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.397s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:35 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:48:35 devstack sudo[77271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:48:35 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:48:36 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root
Sep 04 05:48:36 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:48:36 devstack cinder-volume[76365]: INFO cinder.volume.manager [None req-f04a94ba-7d8a-47e9-b3c6-451847d517ff None None] Driver post RPC initialization completed successfully.
Sep 04 05:48:37 devstack cinder-volume[76207]: DEBUG dbcounter [-] [76207] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:48:46 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writing DB stats cinder:SELECT=4 {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:48:46 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:49:13 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager._thread_info {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:49:13 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread count: 6 {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:49:13 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread info: [<_MainThread(MainThread, started 132349085089920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132348970651520)>, <Thread(Thread-3 (stat_writer), started daemon 132348970649600)>, <Thread(Rabbit-heartbeat, started daemon 132348972124864)>, <Thread(Thread-5 (_runner), started daemon 132348970009408)>, <Thread(Thread-7 (_runner), started daemon 132348970174912)>] {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:50:13 devstack sudo[82402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:50:13 devstack sudo[82402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:50:13 devstack sudo[82402]: pam_unix(sudo:session): session closed for user root
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:50:13 devstack sudo[82405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:50:13 devstack sudo[82405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:50:13 devstack sudo[82405]: pam_unix(sudo:session): session closed for user root
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:50:13 devstack sudo[82408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:50:13 devstack sudo[82408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:50:13 devstack sudo[82408]: pam_unix(sudo:session): session closed for user root
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:50:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:50:13 devstack sudo[82411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:50:13 devstack sudo[82411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:50:14 devstack sudo[82411]: pam_unix(sudo:session): session closed for user root
Sep 04 05:50:14 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:50:14 devstack cinder-volume[76365]: DEBUG cinder.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Notifying Schedulers of capabilities ... {{(pid=76365) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:50:14 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager._thread_info {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:50:14 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread count: 6 {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:50:14 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread info: [<_MainThread(MainThread, started 132349085089920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132348970651520)>, <Thread(Thread-3 (stat_writer), started daemon 132348970649600)>, <Thread(Rabbit-heartbeat, started daemon 132348972124864)>, <Thread(Thread-5 (_runner), started daemon 132348970009408)>, <Thread(Thread-7 (_runner), started daemon 132348970174912)>] {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:50:46 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writing DB stats cinder:SELECT=1 {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:50:46 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writing DB stats cinder:UPDATE=1 {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:51:13 devstack sudo[84005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:51:13 devstack sudo[84005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:51:13 devstack sudo[84005]: pam_unix(sudo:session): session closed for user root
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:51:13 devstack sudo[84010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:51:13 devstack sudo[84010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:51:13 devstack sudo[84010]: pam_unix(sudo:session): session closed for user root
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:51:13 devstack sudo[84023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:51:13 devstack sudo[84023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:51:13 devstack sudo[84023]: pam_unix(sudo:session): session closed for user root
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:51:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:51:13 devstack sudo[84042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:51:13 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:51:14 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root
Sep 04 05:51:14 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:51:14 devstack cinder-volume[76365]: DEBUG cinder.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Notifying Schedulers of capabilities ... {{(pid=76365) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:51:14 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager._thread_info {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:51:14 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread count: 6 {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:51:14 devstack cinder-volume[76365]: DEBUG cinder.volume.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] thread info: [<_MainThread(MainThread, started 132349085089920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 132348970651520)>, <Thread(Thread-3 (stat_writer), started daemon 132348970649600)>, <Thread(Rabbit-heartbeat, started daemon 132348972124864)>, <Thread(Thread-5 (_runner), started daemon 132348970009408)>, <Thread(Thread-7 (_runner), started daemon 132348970174912)>] {{(pid=76365) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_service.periodic_task [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76365) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG cinder.volume.drivers.lvm [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Updating volume stats {{(pid=76365) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:13 devstack sudo[85473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 04 05:52:13 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:13 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:13 devstack sudo[85483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:52:13 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:13 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:13 devstack sudo[85486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 04 05:52:13 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:13 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:13 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:13 devstack sudo[85492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 04 05:52:13 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:14 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:14 devstack cinder-volume[76365]: DEBUG oslo_concurrency.processutils [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76365) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:14 devstack cinder-volume[76365]: DEBUG cinder.manager [None req-3b224cdb-39aa-4fb0-8532-a463ecae2049 None None] Notifying Schedulers of capabilities ... {{(pid=76365) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:52:46 devstack cinder-volume[76365]: DEBUG dbcounter [-] [76365] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76365) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:52:50 devstack cinder-volume[76207]: INFO oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Caught SIGTERM, stopping children
Sep 04 05:52:50 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Acquiring lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:52:50 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Acquired lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:52:50 devstack cinder-volume[76207]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Releasing lock "singleton_lock" {{(pid=76207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:52:50 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Stop services. {{(pid=76207) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 04 05:52:50 devstack cinder-volume[76207]: DEBUG oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Killing children. {{(pid=76207) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 04 05:52:50 devstack cinder-volume[76207]: INFO oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Waiting on 1 children to exit
Sep 04 05:52:54 devstack cinder-volume[76365]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Acquiring lock "singleton_lock" {{(pid=76365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:52:54 devstack cinder-volume[76365]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Acquired lock "singleton_lock" {{(pid=76365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:52:54 devstack cinder-volume[76365]: DEBUG oslo_concurrency.lockutils [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Releasing lock "singleton_lock" {{(pid=76365) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:52:54 devstack cinder-volume[76365]: WARNING amqp [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 05:52:54 devstack cinder-volume[76365]: WARNING amqp [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 05:52:54 devstack cinder-volume[76207]: INFO oslo_service.backend._eventlet.service [None req-057de5ad-67b0-489b-aa3a-e2a9cb9af334 None None] Child 76365 exited with status 0
Sep 04 05:52:55 devstack cinder-volume[86337]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 05:52:55 devstack cinder-volume[86337]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 05:52:55 devstack cinder-volume[86337]: we strongly recommend against using it for new projects.
Sep 04 05:52:55 devstack cinder-volume[86337]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 05:52:55 devstack cinder-volume[86337]: framework.  For more detail see
Sep 04 05:52:55 devstack cinder-volume[86337]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 05:52:55 devstack cinder-volume[86337]:   import eventlet  # noqa
Sep 04 05:52:57 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:52:57 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:52:57 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO dbcounter [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Registered counter for database cinder
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_db.sqlalchemy.engines [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG dbcounter [-] [86337] Writer thread running {{(pid=86337) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO cinder.rpc [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO cinder.rpc [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_db.sqlalchemy.engines [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO cinder.volume.manager [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Determined volume DB was empty at startup.
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG cinder.volume.manager [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86337) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO cinder.volume.manager [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 04 05:52:58 devstack cinder-volume[86337]: WARNING stevedore.named [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 05:52:58 devstack cinder-volume[86337]: WARNING castellan.key_manager [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:52:58 devstack cinder-volume[86337]: WARNING cinder.keymgr.conf_key_mgr [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO cinder.volume.manager [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_db.sqlalchemy.engines [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86337) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:52:58 devstack cinder-volume[86337]: INFO oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Starting 1 workers
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Started child 86551 {{(pid=86337) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Full set of CONF: {{(pid=86337) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] ******************************************************************************** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Configuration options gathered from: {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] ================================================================================ {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] allow_availability_zone_fallback = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] allow_compression_on_image_upload = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] allowed_direct_url_schemes     = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] api_rate_limit                 = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] auth_strategy                  = keystone {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_availability_zone      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_host                   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_name                   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_stats_polling_interval = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backup_api_class               = cinder.backup.api.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backup_name_template           = backup-%s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backup_use_same_host           = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backup_use_temp_snapshot       = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] chap_password                  = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86551]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] chap_username                  =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_internal_tenant_project_id = 6d4e73e8eb5d4ec1a03dbc0e1f5d241c {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_internal_tenant_user_id = bb10d0bed7124fa1a39216725111bd29 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cluster                        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] compression_format             = gzip {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] config_dir                     = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] config_source                  = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] control_exchange               = openstack {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] debug                          = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] default_availability_zone      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] default_group_type             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] default_volume_type            = QuobyteHD {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] disk_geometry                  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_client_cert             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_client_cert_key         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_data_namespace          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_ssl_cert_path           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_ssl_cert_verify         = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] driver_use_ssl                 = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] enable_new_services            = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] enable_unsupported_driver      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] enforce_multipath_for_image_xfer = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] filter_function                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_api_insecure            = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_api_servers             = ['http://192.168.122.39/image'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_api_ssl_compression     = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_ca_certificates_file    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_certfile                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_keyfile                 = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_num_retries             = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance_request_timeout         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] goodness_function              = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] graceful_shutdown_timeout      = 5 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] group_api_class                = cinder.group.api.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] host                           = devstack {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_compress_on_upload       = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_conversion_address_space_limit = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_conversion_cpu_limit     = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_conversion_disable       = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_upload_use_cinder_backend = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_upload_use_internal_tenant = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_volume_cache_enabled     = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_volume_cache_max_count   = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] image_volume_cache_max_size_gb = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] init_host_max_objects_retrieval = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iscsi_target_flags             =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iscsi_write_cache              = on {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iser_helper                    = tgtadm {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iser_ip_address                = 192.168.122.39 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iser_port                      = 3260 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_color                      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_config_append              = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_dir                        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_file                       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_options                    = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_rotate_interval            = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_rotate_interval_type       = days {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] log_rotation_type              = none {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] max_age                        = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] max_logfile_count              = 30 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] max_logfile_size_mb            = 200 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] max_over_subscription_ratio    = 20.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] message_reap_interval          = 86400 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] message_ttl                    = 2592000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] migration_create_volume_timeout_secs = 300 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] monkey_patch                   = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] monkey_patch_modules           = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] my_ip                          = 192.168.122.39 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] no_snapshot_gb_quota           = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] num_iser_scan_tries            = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] num_shell_tries                = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] num_volume_device_scan_tries   = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] nvmeof_conn_info_version       = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] nvmet_ns_id                    = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] nvmet_port_id                  = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_max_limit                = 1000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_ext_list          = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_listen_port       = 8776 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_use_ssl           = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] osapi_volume_workers           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] per_volume_size_limit          = -1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] periodic_fuzzy_delay           = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] periodic_interval              = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] public_endpoint                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] publish_errors                 = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_backup_gigabytes         = 1000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_backups                  = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_gigabytes                = 1000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_groups                   = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_snapshots                = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] quota_volumes                  = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] rate_limit_burst               = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] rate_limit_except_level        = CRITICAL {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] rate_limit_interval            = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] reinit_driver_count            = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] replication_device             = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] report_discard_supported       = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] report_interval                = 120 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] reservation_clean_interval     = 86400 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] reservation_expire             = 86400 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] reserved_image_namespaces      = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] reserved_percentage            = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] rpc_response_timeout           = 120 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] run_external_periodic_tasks    = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] scst_target_driver             = iscsi {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] scst_target_iqn_name           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_down_time              = 720 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] shell_completion               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] snapshot_name_template         = snapshot-%s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] split_loggers                  = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] state_path                     = /opt/stack/data/cinder {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] storage_availability_zone      = nova {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] storage_protocol               = iSCSI {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] syslog_log_facility            = LOG_USER {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_helper                  = lioadm {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_ip_address              = 192.168.122.39 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_port                    = 3260 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_protocol                = iscsi {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] target_secondary_ip_addresses  = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] trace_flags                    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] transport_url                  = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] until_refresh                  = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_chap_auth                  = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_default_quota_class        = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_journal                    = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_json                       = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_multipath_for_image_xfer   = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_stderr                     = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] use_syslog                     = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] verify_glance_signatures       = enabled {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_api_class               = cinder.volume.api.API {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_backend_name            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_clear                   = zero {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_clear_ionice            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_clear_size              = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_copy_bps_limit          = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_dd_blocksize            = 1M {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_name_template           = volume-%s {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_service_inithost_offload = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volume_usage_audit_period      = month {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] zoning_mode                    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_concurrency.disable_process_locking = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:58 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:58 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.auth_section = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.remotefs [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86551) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.auth_type   = password {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.auth_version = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.cache       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.certfile    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.include_service_catalog = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.insecure    = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.interface   = public {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.keyfile     = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_password = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcache_username = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.region_name = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.service_type = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.backend                  = dogpile.cache.null {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.backend_argument         = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.backend_expiration_time  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.config_prefix            = cache.oslo {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.debug_cache_backend      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.enable_retry_client      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.enable_socket_keepalive  = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.enabled                  = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.expiration_time          = 600 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.hashclient_retry_attempts = 2 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_dead_retry      = 300 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_sasl_enabled    = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.password                 = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.proxies                  = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.redis_db                 = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.redis_server             = localhost:6379 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.retry_attempts           = 2 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.retry_delay              = 0.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.socket_keepalive_count   = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.socket_keepalive_idle    = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.socket_keepalive_interval = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.socket_timeout           = 1.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.tls_allowed_ciphers      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.tls_cafile               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.tls_certfile             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.tls_enabled              = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.tls_keyfile              = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cache.username                 = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] coordination.backend_url       = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.asyncio_connection    = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.asyncio_slave_connection = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.backend               = sqlalchemy {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.connection            = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.connection_debug      = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.connection_parameters =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.connection_recycle_time = 3600 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.connection_trace      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.db_inc_retry_interval = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.db_max_retries        = 20 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.db_max_retry_interval = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.db_retry_interval     = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.max_overflow          = 50 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.max_pool_size         = 5 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.max_retries           = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.mysql_wsrep_sync_wait = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.pool_timeout          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.retry_interval        = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.slave_connection      = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.sqlite_synchronous    = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.synchronous_reader    = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] database.use_db_reconnect      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_tracing.insecure = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.connection_string     = messaging:// {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.enabled               = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.es_doc_type           = notification {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.es_scroll_size        = 10000 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.es_scroll_time        = 2m {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.filter_error_trace    = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.hmac_keys             = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.sentinel_service_name = mymaster {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.socket_timeout        = 0.1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.trace_requests        = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler.trace_sqlalchemy      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler_jaeger.process_tags   = {} {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler_jaeger.service_name_prefix = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] profiler_otlp.service_name_prefix = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.enforce_new_defaults = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.policy_default_rule = default {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.group          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.helper_command = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] privsep_osbrick.user           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.group         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.helper_command = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] cinder_sys_admin.user          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.auth_section      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.auth_type         = password {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.cafile            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.certfile          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.collect_timing    = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.insecure          = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.keyfile           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.send_service_user_token = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.split_loggers     = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.timeout           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.tls_ciphers       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] service_user.tls_min_version   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.auth_section            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.auth_type               = password {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.certfile                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.collect_timing          = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.insecure                = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.keyfile                 = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.region_name             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.split_loggers           = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.timeout                 = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.tls_ciphers             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] glance.tls_min_version         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.backend_availability_zone = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.chap_password = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.chap_username =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.disk_geometry = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_client_cert = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_client_cert_key = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_data_namespace = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.driver_use_ssl = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.extra_capabilities = {} {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.filter_function = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.goodness_function = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iscsi_target_flags =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iscsi_write_cache = on {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iser_port     = 3260 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_host      =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_login     = admin {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_mount_options = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_password  = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_private_key =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_share_path =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.num_shell_tries = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.quobyte_volume_url = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.replication_device = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.report_discard_supported = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.reserved_percentage = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_helper = tgtadm {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86551) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 04 05:52:59 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 04 05:52:59 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_port   = 3260 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_protocol = iscsi {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.trace_flags   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.unique_fqdn_network = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Running cmd (subprocess): mount.quobyte {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.use_chap_auth = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_backend_name = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_clear  = zero {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_clear_ionice = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_clear_size = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_reports.file_event_handler = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_reports.log_dir           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.backend_availability_zone = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.backend_host         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.chap_password        = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.chap_username        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.disk_geometry        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_client_cert   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_data_namespace = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.extra_capabilities   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.filter_function      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.goodness_function    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iser_helper          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iser_ip_address      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iser_port            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_host             = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_login            = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_mount_options    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_password         = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_private_key      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_share_path       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.num_shell_tries      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.replication_device   = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.report_discard_supported = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.reserved_percentage  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.scst_target_driver   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.storage_protocol     = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_helper        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_ip_address    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_port          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_prefix        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_protocol      = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.trace_flags          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.use_chap_auth        = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_clear         = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_clear_size    = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] QuobyteHD.volumes_dir          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_notifications.driver = [] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_notifications.retry = -1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] key_manager.fixed_key          = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.barbican_api_version  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.barbican_endpoint     = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.barbican_endpoint_type = public {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.barbican_region_name  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.cafile                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.certfile              = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.collect_timing        = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.insecure              = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.keyfile               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.number_of_retries     = 60 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.retry_delay           = 1 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.send_service_user_token = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.split_loggers         = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.timeout               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.tls_ciphers           = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.tls_min_version       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.verify_ssl            = True {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican.verify_ssl_path       = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.auth_section = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.auth_type = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.cafile   = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.certfile = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.collect_timing = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.insecure = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.keyfile  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.split_loggers = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.timeout  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.tls_ciphers = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] barbican_service_user.tls_min_version = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.approle_role_id          = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.approle_secret_id        = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.auth_method              = approle {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.auth_path                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.kv_mountpoint            = secret {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.kv_path                  = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.kv_version               = 2 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.namespace                = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.root_token_id            = **** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.ssl_ca_crt_file          = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.timeout                  = 60.0 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.token_file               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.token_role               = None {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.use_ssl                  = False {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:52:59 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] ******************************************************************************** {{(pid=86337) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 05:52:59 devstack quobyte-client[86556]: Reading configuration file: /etc/quobyte/client.cfg
Sep 04 05:52:59 devstack quobyte-client[86556]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] CMD "mount.quobyte" returned: 1 in 0.114s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:52:59 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 ...
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 -c /etc/quobyte/client-cinder.cfg {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:59 devstack sudo[86557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 -c /etc/quobyte/client-cinder.cfg
Sep 04 05:52:59 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:59 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.447s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:59 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 succeeded
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.459s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:52:59 devstack sudo[86626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:52:59 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:52:59 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.261s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:52:59 devstack cinder-volume[86551]: INFO cinder.volume.driver [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 05:52:59 devstack cinder-volume[86551]: DEBUG cinder.volume.driver [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86551) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.db.api [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Building query based on filter {{(pid=86551) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.image.image_utils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86551) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 05:53:00 devstack cinder-volume[86551]: INFO cinder.keymgr.migration [None req-31fc8018-bf91-44eb-b013-6ccb7c5a5fba None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:00 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:53:00 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:53:00 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.335s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Notifying Schedulers of capabilities ... {{(pid=86551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:53:00 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Driver initialization completed successfully.
Sep 04 05:53:00 devstack cinder-volume[86551]: INFO cinder.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Initiating service 3 cleanup
Sep 04 05:53:00 devstack cinder-volume[86551]: INFO cinder.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Service 3 cleanup completed.
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.service [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Creating RPC server for service cinder-volume {{(pid=86551) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.service [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86551) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 05:53:00 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:53:00 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:00 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:53:00 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:53:01 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Sep 04 05:53:01 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.398s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:01 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-aa69077f-f81c-4cf3-9746-637d21ccfffe None None] Driver post RPC initialization completed successfully.
Sep 04 05:53:04 devstack cinder-volume[86337]: INFO oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Caught SIGTERM, stopping children
Sep 04 05:53:04 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Acquiring lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:53:04 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Acquired lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:53:04 devstack cinder-volume[86337]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Releasing lock "singleton_lock" {{(pid=86337) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:53:04 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Stop services. {{(pid=86337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Sep 04 05:53:04 devstack cinder-volume[86337]: DEBUG oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Killing children. {{(pid=86337) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Sep 04 05:53:04 devstack cinder-volume[86337]: INFO oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Waiting on 1 children to exit
Sep 04 05:53:04 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:53:04 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:53:04 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:53:04 devstack cinder-volume[86551]: WARNING amqp [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 05:53:04 devstack cinder-volume[86551]: WARNING amqp [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 04 05:53:04 devstack cinder-volume[86337]: INFO oslo_service.backend._eventlet.service [None req-7cfdec6a-4de5-4281-b376-7a290c5b1212 None None] Child 86551 exited with status 0
Sep 04 05:53:05 devstack cinder-volume[86824]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Sep 04 05:53:05 devstack cinder-volume[86824]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 05:53:05 devstack cinder-volume[86824]: we strongly recommend against using it for new projects.
Sep 04 05:53:05 devstack cinder-volume[86824]: If you are already using Eventlet, we recommend migrating to a different
Sep 04 05:53:05 devstack cinder-volume[86824]: framework.  For more detail see
Sep 04 05:53:05 devstack cinder-volume[86824]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 05:53:05 devstack cinder-volume[86824]:   import eventlet  # noqa
Sep 04 05:53:08 devstack cinder-volume[86824]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Sep 04 05:53:08 devstack cinder-volume[86824]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Sep 04 05:53:08 devstack cinder-volume[86824]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86824) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Sep 04 05:53:09 devstack cinder-volume[86824]: INFO dbcounter [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Registered counter for database cinder
Sep 04 05:53:09 devstack cinder-volume[86824]: DEBUG oslo_db.sqlalchemy.engines [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG dbcounter [-] [86824] Writer thread running {{(pid=86824) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:53:10 devstack cinder-volume[86824]: INFO cinder.rpc [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 04 05:53:10 devstack cinder-volume[86824]: INFO cinder.rpc [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_db.sqlalchemy.engines [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:53:10 devstack cinder-volume[86824]: INFO cinder.volume.manager [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Determined volume DB was empty at startup.
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG cinder.volume.manager [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86824) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Sep 04 05:53:10 devstack cinder-volume[86824]: WARNING stevedore.named [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 04 05:53:10 devstack cinder-volume[86824]: WARNING castellan.key_manager [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:53:10 devstack cinder-volume[86824]: WARNING cinder.keymgr.conf_key_mgr [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 04 05:53:10 devstack cinder-volume[86824]: INFO cinder.volume.manager [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_db.sqlalchemy.engines [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86824) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:53:10 devstack cinder-volume[86824]: INFO oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Starting 1 workers
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Started child 87095 {{(pid=86824) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Full set of CONF: {{(pid=86824) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] ******************************************************************************** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] Configuration options gathered from: {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] ================================================================================ {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] allow_availability_zone_fallback = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] allow_compression_on_image_upload = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] allowed_direct_url_schemes     = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] api_rate_limit                 = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] auth_strategy                  = keystone {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_availability_zone      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[87095]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_host                   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_name                   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_stats_polling_interval = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backup_api_class               = cinder.backup.api.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backup_name_template           = backup-%s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backup_use_same_host           = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backup_use_temp_snapshot       = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] chap_password                  = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] chap_username                  =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_internal_tenant_project_id = 6d4e73e8eb5d4ec1a03dbc0e1f5d241c {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_internal_tenant_user_id = bb10d0bed7124fa1a39216725111bd29 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cluster                        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] compression_format             = gzip {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] config_dir                     = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] config_source                  = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] control_exchange               = openstack {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] debug                          = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] default_availability_zone      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] default_group_type             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] default_volume_type            = QuobyteHD {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] disk_geometry                  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_client_cert             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_client_cert_key         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_data_namespace          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_ssl_cert_path           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_ssl_cert_verify         = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] driver_use_ssl                 = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] enable_new_services            = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] enable_unsupported_driver      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] enforce_multipath_for_image_xfer = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] filter_function                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_api_insecure            = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_api_servers             = ['http://192.168.122.39/image'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_api_ssl_compression     = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_ca_certificates_file    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_certfile                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_keyfile                 = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_num_retries             = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance_request_timeout         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] goodness_function              = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] graceful_shutdown_timeout      = 5 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] group_api_class                = cinder.group.api.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] host                           = devstack {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_compress_on_upload       = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_conversion_address_space_limit = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_conversion_cpu_limit     = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_conversion_disable       = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_upload_use_cinder_backend = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_upload_use_internal_tenant = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_volume_cache_enabled     = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_volume_cache_max_count   = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] init_host_max_objects_retrieval = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iscsi_target_flags             =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iscsi_write_cache              = on {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iser_helper                    = tgtadm {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iser_ip_address                = 192.168.122.39 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iser_port                      = 3260 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_color                      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_config_append              = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_dir                        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_file                       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_options                    = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_rotate_interval            = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_rotate_interval_type       = days {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] log_rotation_type              = none {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] max_age                        = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] max_logfile_count              = 30 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] max_logfile_size_mb            = 200 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] max_over_subscription_ratio    = 20.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] message_reap_interval          = 86400 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] message_ttl                    = 2592000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] monkey_patch                   = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] monkey_patch_modules           = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] my_ip                          = 192.168.122.39 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] no_snapshot_gb_quota           = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] num_iser_scan_tries            = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] num_shell_tries                = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] num_volume_device_scan_tries   = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] nvmeof_conn_info_version       = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] nvmet_ns_id                    = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] nvmet_port_id                  = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_max_limit                = 1000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_ext_list          = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_listen_port       = 8776 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_use_ssl           = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] osapi_volume_workers           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] per_volume_size_limit          = -1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] periodic_fuzzy_delay           = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] periodic_interval              = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] public_endpoint                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Starting volume driver QuobyteDriver (1.2.1)
Sep 04 05:53:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87095) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] publish_errors                 = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_backup_gigabytes         = 1000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_backups                  = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_gigabytes                = 1000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_groups                   = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_snapshots                = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] quota_volumes                  = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] rate_limit_burst               = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] rate_limit_except_level        = CRITICAL {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] rate_limit_interval            = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] reinit_driver_count            = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] replication_device             = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] report_discard_supported       = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] report_interval                = 120 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] reservation_clean_interval     = 86400 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] reservation_expire             = 86400 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] reserved_image_namespaces      = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] reserved_percentage            = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] rpc_response_timeout           = 120 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] run_external_periodic_tasks    = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] scst_target_driver             = iscsi {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] scst_target_iqn_name           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_down_time              = 720 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] shell_completion               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] snapshot_name_template         = snapshot-%s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] split_loggers                  = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] state_path                     = /opt/stack/data/cinder {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] storage_availability_zone      = nova {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] storage_protocol               = iSCSI {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] syslog_log_facility            = LOG_USER {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_helper                  = lioadm {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_ip_address              = 192.168.122.39 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_port                    = 3260 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_protocol                = iscsi {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] target_secondary_ip_addresses  = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] trace_flags                    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] transport_url                  = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] until_refresh                  = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_chap_auth                  = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_default_quota_class        = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_journal                    = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_json                       = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_multipath_for_image_xfer   = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_stderr                     = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] use_syslog                     = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] verify_glance_signatures       = enabled {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_api_class               = cinder.volume.api.API {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_backend_name            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_clear                   = zero {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_clear_ionice            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_clear_size              = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_copy_bps_limit          = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_dd_blocksize            = 1M {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_name_template           = volume-%s {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_service_inithost_offload = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volume_usage_audit_period      = month {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] zoning_mode                    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.auth_section = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.auth_type   = password {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.auth_version = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.cache       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.certfile    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.insecure    = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.interface   = public {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.keyfile     = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_password = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcache_username = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.region_name = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.service_type = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.39/identity {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.backend                  = dogpile.cache.null {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.backend_argument         = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.backend_expiration_time  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.config_prefix            = cache.oslo {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.debug_cache_backend      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.enable_retry_client      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.enable_socket_keepalive  = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.enabled                  = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.expiration_time          = 600 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_dead_retry      = 300 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_sasl_enabled    = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.password                 = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.proxies                  = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.redis_db                 = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.redis_server             = localhost:6379 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.retry_attempts           = 2 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.retry_delay              = 0.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.socket_keepalive_count   = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.socket_keepalive_idle    = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.socket_keepalive_interval = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.socket_timeout           = 1.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.tls_allowed_ciphers      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.tls_cafile               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.tls_certfile             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.tls_enabled              = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.tls_keyfile              = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cache.username                 = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] coordination.backend_url       = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.asyncio_connection    = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.asyncio_slave_connection = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.backend               = sqlalchemy {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.connection            = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.connection_debug      = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.connection_parameters =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.connection_recycle_time = 3600 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.connection_trace      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.db_inc_retry_interval = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.db_max_retries        = 20 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.db_max_retry_interval = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87095) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.db_retry_interval     = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.max_overflow          = 50 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.max_pool_size         = 5 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.max_retries           = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.pool_timeout          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.retry_interval        = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:10 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.slave_connection      = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Running cmd (subprocess): mount.quobyte {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.sqlite_synchronous    = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.synchronous_reader    = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] database.use_db_reconnect      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_tracing.insecure = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.connection_string     = messaging:// {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.enabled               = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.es_doc_type           = notification {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.es_scroll_size        = 10000 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.es_scroll_time        = 2m {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.filter_error_trace    = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.hmac_keys             = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.sentinel_service_name = mymaster {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.socket_timeout        = 0.1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.trace_requests        = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler.trace_sqlalchemy      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler_jaeger.process_tags   = {} {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] profiler_otlp.service_name_prefix = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.policy_default_rule = default {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.group          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.helper_command = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] privsep_osbrick.user           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.group         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.helper_command = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] cinder_sys_admin.user          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.auth_section      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.auth_type         = password {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.cafile            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.certfile          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.collect_timing    = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.insecure          = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.keyfile           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.send_service_user_token = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.split_loggers     = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.timeout           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.tls_ciphers       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] service_user.tls_min_version   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.auth_section            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.auth_type               = password {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.certfile                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.collect_timing          = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.insecure                = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.keyfile                 = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.region_name             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.split_loggers           = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.timeout                 = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.tls_ciphers             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] glance.tls_min_version         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.backend_availability_zone = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.chap_password = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.chap_username =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.disk_geometry = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_client_cert = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_data_namespace = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.driver_use_ssl = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.extra_capabilities = {} {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.filter_function = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.goodness_function = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iscsi_target_flags =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iser_ip_address = 192.168.122.39 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iser_port     = 3260 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_host      =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_login     = admin {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_mount_options = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_password  = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_private_key =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_share_path =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.replication_device = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.report_discard_supported = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_helper = tgtadm {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_ip_address = 192.168.122.39 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_port   = 3260 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_protocol = iscsi {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.trace_flags   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.use_chap_auth = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_backend_name = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_clear  = zero {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_reports.file_event_handler = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_reports.log_dir           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.backend_host         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.chap_password        = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.chap_username        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.disk_geometry        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_client_cert   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.extra_capabilities   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.filter_function      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.goodness_function    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack quobyte-client[87106]: Reading configuration file: /etc/quobyte/client.cfg
Sep 04 05:53:11 devstack quobyte-client[87106]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iser_helper          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iser_ip_address      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iser_port            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_host             = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_login            = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] CMD "mount.quobyte" returned: 1 in 0.158s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_mount_options    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_password         = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_private_key      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_share_path       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.num_shell_tries      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.replication_device   = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.report_discard_supported = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.reserved_percentage  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.scst_target_driver   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.storage_protocol     = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_helper        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_ip_address    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_port          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_prefix        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_protocol      = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.trace_flags          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.use_chap_auth        = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_clear         = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_clear_size    = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] QuobyteHD.volumes_dir          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_notifications.driver = [] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] key_manager.fixed_key          = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.barbican_api_version  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.barbican_endpoint     = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.barbican_endpoint_type = public {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.barbican_region_name  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.cafile                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.certfile              = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.collect_timing        = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.insecure              = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.keyfile               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.number_of_retries     = 60 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.retry_delay           = 1 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.send_service_user_token = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.split_loggers         = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.timeout               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack sudo[87107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.tls_ciphers           = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.tls_min_version       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.verify_ssl            = True {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican.verify_ssl_path       = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.auth_section = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.auth_type = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.cafile   = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.certfile = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.collect_timing = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.insecure = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.keyfile  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.split_loggers = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.timeout  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.tls_ciphers = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] barbican_service_user.tls_min_version = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.approle_role_id          = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.approle_secret_id        = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.auth_method              = approle {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.auth_path                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.kv_mountpoint            = secret {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.kv_path                  = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.kv_version               = 2 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.namespace                = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.root_token_id            = **** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.ssl_ca_crt_file          = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.timeout                  = 60.0 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.token_file               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.token_role               = None {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.use_ssl                  = False {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Sep 04 05:53:11 devstack cinder-volume[86824]: DEBUG oslo_service.backend._eventlet.service [None req-6a51b718-93f9-4eb7-b649-176389d4d9c4 None None] ******************************************************************************** {{(pid=86824) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Sep 04 05:53:11 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:11 devstack cinder-volume[87095]: INFO cinder.volume.driver [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Driver hasn't implemented _init_vendor_properties()
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.volume.driver [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_db.sqlalchemy.engines [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87095) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writer thread running {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.db.api [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Building query based on filter {{(pid=87095) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87095) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:11 devstack cinder-volume[87095]: INFO cinder.keymgr.migration [None req-b028b7e0-b90e-4d20-aeee-d32656c16561 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 04 05:53:11 devstack sudo[87121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:53:11 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:53:11 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:53:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Driver initialization completed successfully.
Sep 04 05:53:12 devstack cinder-volume[87095]: INFO cinder.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Initiating service 3 cleanup
Sep 04 05:53:12 devstack cinder-volume[87095]: INFO cinder.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Service 3 cleanup completed.
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.service [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Creating RPC server for service cinder-volume {{(pid=87095) start /opt/stack/cinder/cinder/service.py:231}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.service [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87095) start /opt/stack/cinder/cinder/service.py:237}}
Sep 04 05:53:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:53:12 devstack sudo[87134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:53:12 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:53:12 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:53:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b987cf04-e914-4b63-9528-4c44cd344536 None None] Driver post RPC initialization completed successfully.
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 6 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:53:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:53:20 devstack cinder-volume[86824]: DEBUG dbcounter [-] [86824] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86824) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:53:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:53:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:12 devstack sudo[87653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:54:12 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:12 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:54:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:54:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 6 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:54:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Flow 'volume_create_manager' (d2f9c89c-8a3c-4a45-9efe-b3be4e0691b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecc03a6-c820-46ee-a750-67a81430ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cecc03a6-c820-46ee-a750-67a81430ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-859934516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf9b9f-0a16-4b4d-972f-e016f97df71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1283a39cd9e54a76910fa136a4ed471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:24Z,use_quota=True,user_id='a86d4bed5835410b893a7180ce6338f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de892622-edd0-4e0d-8eea-ef07f917e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de892622-edd0-4e0d-8eea-ef07f917e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca9c0ca-6dc9-45a4-90e0-7572759ed9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca9c0ca-6dc9-45a4-90e0-7572759ed9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cf9b9f-0a16-4b4d-972f-e016f97df71c', 'volume_name': 'volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1a31ff-700f-4fc9-965c-11d744fef545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1a31ff-700f-4fc9-965c-11d744fef545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefc6bd1-acd8-4f78-abeb-4df7428aaa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Volume 41cf9b9f-0a16-4b4d-972f-e016f97df71c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c', 'volume_size': 1}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-859934516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cf9b9f-0a16-4b4d-972f-e016f97df71c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1283a39cd9e54a76910fa136a4ed471b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:24Z,use_quota=True,user_id='a86d4bed5835410b893a7180ce6338f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Creating volume 41cf9b9f-0a16-4b4d-972f-e016f97df71c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:54:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:54:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:24 devstack sudo[87862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c 1073741824
Sep 04 05:54:24 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:26 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c 1073741824" returned: 0 in 1.572s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:26 devstack sudo[88187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c
Sep 04 05:54:26 devstack sudo[88187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:26 devstack sudo[88187]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c" returned: 0 in 0.478s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:54:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefc6bd1-acd8-4f78-abeb-4df7428aaa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1513b41-cd04-4436-bd4b-5085b0e2fdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Volume volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c (41cf9b9f-0a16-4b4d-972f-e016f97df71c): created successfully
Sep 04 05:54:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1513b41-cd04-4436-bd4b-5085b0e2fdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Flow 'volume_create_manager' (d2f9c89c-8a3c-4a45-9efe-b3be4e0691b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c1bf3001-bdac-433a-9f6e-9106fc457522 tempest-DeleteServersTestJSON-1146661688 None] Created volume successfully.
Sep 04 05:54:33 devstack cinder-volume[87095]: WARNING py.warnings [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Sep 04 05:54:33 devstack cinder-volume[87095]:   .first()
Sep 04 05:54:33 devstack cinder-volume[87095]: 
Sep 04 05:54:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8befd8bd-6044-4e98-826d-aaa946f19756', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:54:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-dba8b942-e6c1-4cac-bf86-ba3b755bb9dd req-dd793a1f-9eec-4ef1-992d-d6b8aef3f648 tempest-DeleteServersTestJSON-1146661688 None] attachment_update completed successfully.
Sep 04 05:54:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-ee830e47-0980-49f2-a1bc-77a7f5425881 req-e08a217d-7f82-485d-a1de-58a1949277dc tempest-DeleteServersTestJSON-1146661688 None] Terminate volume connection completed successfully.
Sep 04 05:54:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-ee830e47-0980-49f2-a1bc-77a7f5425881 req-e08a217d-7f82-485d-a1de-58a1949277dc tempest-DeleteServersTestJSON-1146661688 None] Deleting attachment 8befd8bd-6044-4e98-826d-aaa946f19756. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:54:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "cinder-41cf9b9f-0a16-4b4d-972f-e016f97df71c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:54:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "cinder-41cf9b9f-0a16-4b4d-972f-e016f97df71c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:54:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "cinder-quobyte-41cf9b9f-0a16-4b4d-972f-e016f97df71c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:54:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "cinder-quobyte-41cf9b9f-0a16-4b4d-972f-e016f97df71c" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:54:40 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3hynuytb/privsep.sock']
Sep 04 05:54:40 devstack sudo[88797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3hynuytb/privsep.sock
Sep 04 05:54:40 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Flow 'volume_create_manager' (1457111c-754f-4ce5-9e3c-7fcb4520fb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41d37-ad53-4852-b606-b61ebef5e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb41d37-ad53-4852-b606-b61ebef5e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1351577069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775339f-3e10-4bfe-b5e0-84851f54635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3d188909234a44b5970ef3ee953259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:41Z,use_quota=True,user_id='6d5a56c4b99f4140a56a68f116a64a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cd297-9019-4423-a4b4-c100c56aa4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029cd297-9019-4423-a4b4-c100c56aa4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ab2ffe-6ca5-461d-9a83-7e727cd1e92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ab2ffe-6ca5-461d-9a83-7e727cd1e92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f775339f-3e10-4bfe-b5e0-84851f54635e', 'volume_name': 'volume-f775339f-3e10-4bfe-b5e0-84851f54635e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda04e9-f0bf-43ce-8a4f-c56784605e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda04e9-f0bf-43ce-8a4f-c56784605e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86574f-2f62-4f6b-b45e-2724a5473e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Volume f775339f-3e10-4bfe-b5e0-84851f54635e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f775339f-3e10-4bfe-b5e0-84851f54635e', 'volume_size': 1}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1351577069',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f775339f-3e10-4bfe-b5e0-84851f54635e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3d188909234a44b5970ef3ee953259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:41Z,use_quota=True,user_id='6d5a56c4b99f4140a56a68f116a64a9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Creating volume f775339f-3e10-4bfe-b5e0-84851f54635e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:54:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:54:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:41 devstack sudo[88802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e 1073741824
Sep 04 05:54:41 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log: 
Sep 04 05:54:41 devstack cinder-volume[87095]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Sep 04 05:54:42 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Spawned new privsep daemon via rootwrap
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Accepted privsep connection to /tmp/tmp3hynuytb/privsep.sock {{(pid=87095) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88806
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a935c-d008-49a8-bce5-2222c29a1741]: (2,) {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:54:42 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25a2d9e-b8cc-4ebc-93f9-e7aa974bb244]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e 1073741824" returned: 0 in 0.688s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:42 devstack sudo[88811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e
Sep 04 05:54:42 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:42 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c
Sep 04 05:54:42 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:42 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c86574f-2f62-4f6b-b45e-2724a5473e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f775339f-3e10-4bfe-b5e0-84851f54635e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84fc2d7-69e3-43e6-ae05-f28fa1e9ee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Volume volume-f775339f-3e10-4bfe-b5e0-84851f54635e (f775339f-3e10-4bfe-b5e0-84851f54635e): created successfully
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c84fc2d7-69e3-43e6-ae05-f28fa1e9ee5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Flow 'volume_create_manager' (1457111c-754f-4ce5-9e3c-7fcb4520fb5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4142cd95-74c4-4756-8458-1ca6af8b6953 tempest-VolumesAdminNegativeTest-1381888146 None] Created volume successfully.
Sep 04 05:54:42 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c" returned: 0 in 0.555s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:42 devstack sudo[88818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c
Sep 04 05:54:42 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:43 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-41cf9b9f-0a16-4b4d-972f-e016f97df71c" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "cinder-quobyte-41cf9b9f-0a16-4b4d-972f-e016f97df71c" released by "delete_volume" :: held 2.552s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:54:43 devstack cinder-volume[87095]: WARNING cinder.quota [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:54:43 devstack cinder-volume[87095]: WARNING cinder.quota [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Created reservations ['c378d7e7-7f66-49d1-8a5b-3f72a6cbda4f', 'ca43f449-2933-4dc3-a9e8-74c8e4fe0599', '69333d14-afb7-4a52-b480-e53feed13b32', '34a95046-869a-4d57-8eab-24ad16c1a93f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:43 devstack sudo[88822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:54:43 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:43 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:54:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Deleted volume successfully.
Sep 04 05:54:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-68f22604-ec9e-499d-81f1-6fcac9911a30 tempest-DeleteServersTestJSON-1146661688 None] Lock "cinder-41cf9b9f-0a16-4b4d-972f-e016f97df71c-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Acquiring lock "cinder-f775339f-3e10-4bfe-b5e0-84851f54635e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "cinder-f775339f-3e10-4bfe-b5e0-84851f54635e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Acquiring lock "cinder-quobyte-f775339f-3e10-4bfe-b5e0-84851f54635e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "cinder-quobyte-f775339f-3e10-4bfe-b5e0-84851f54635e" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a66c3-7de4-449e-8824-a45f8b70ae48]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:44 devstack sudo[88825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e
Sep 04 05:54:44 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:44 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:45 devstack sudo[88830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e
Sep 04 05:54:45 devstack sudo[88830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:45 devstack sudo[88830]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f775339f-3e10-4bfe-b5e0-84851f54635e" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "cinder-quobyte-f775339f-3e10-4bfe-b5e0-84851f54635e" released by "delete_volume" :: held 0.885s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Created reservations ['37dcfad3-4250-40e9-a07d-0c953c30ff13', '845f91d4-a451-445f-b744-d14b3b0e5e61', 'cca07e1f-a775-4b96-a9f0-9f0cfa4786d4', 'bd4b19a2-01fc-4402-91bd-359a4c8d1d36'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:45 devstack sudo[88839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:54:45 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:46 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:54:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Deleted volume successfully.
Sep 04 05:54:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8814c9c1-2570-44d6-b900-c83d90cf1eab tempest-VolumesAdminNegativeTest-1381888146 None] Lock "cinder-f775339f-3e10-4bfe-b5e0-84851f54635e-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (029930f1-cd10-43b7-9b5e-1d736a5df3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f26ce2-6742-40bd-baa7-a97cc2ab6efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f26ce2-6742-40bd-baa7-a97cc2ab6efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1524804893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef05efa-c157-4405-bddd-adf1655a2165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:52Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e5ccb-9c60-477c-b846-1eade8462970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d33e5ccb-9c60-477c-b846-1eade8462970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598ba611-4412-4b6a-9721-c8ddea8a0a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (598ba611-4412-4b6a-9721-c8ddea8a0a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef05efa-c157-4405-bddd-adf1655a2165', 'volume_name': 'volume-2ef05efa-c157-4405-bddd-adf1655a2165', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9067889-03ca-45c3-b83a-57ed670a0fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9067889-03ca-45c3-b83a-57ed670a0fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fde844-dc9f-49a4-9fe1-336a038f06db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Volume 2ef05efa-c157-4405-bddd-adf1655a2165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef05efa-c157-4405-bddd-adf1655a2165', 'volume_size': 1}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1524804893',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef05efa-c157-4405-bddd-adf1655a2165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:54:52Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Creating volume 2ef05efa-c157-4405-bddd-adf1655a2165 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:54:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:54:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:52 devstack sudo[88881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 1073741824
Sep 04 05:54:52 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:53 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 1073741824" returned: 0 in 0.607s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:54:53 devstack sudo[88887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165
Sep 04 05:54:53 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:54:53 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fde844-dc9f-49a4-9fe1-336a038f06db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef05efa-c157-4405-bddd-adf1655a2165', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f120110-f986-45c5-ac1a-5342e885de14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:54:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Volume volume-2ef05efa-c157-4405-bddd-adf1655a2165 (2ef05efa-c157-4405-bddd-adf1655a2165): created successfully
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f120110-f986-45c5-ac1a-5342e885de14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:54:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (029930f1-cd10-43b7-9b5e-1d736a5df3d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:54:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-27ff007d-0138-49f4-bbc5-197b4f9b0395 tempest-AttachVolumeTestJSON-652029681 None] Created volume successfully.
Sep 04 05:54:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c875f4e3-efa0-4528-b672-e9b7385133b6 req-c447cb25-9da9-4e24-920c-06e6c030980a tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:54:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c875f4e3-efa0-4528-b672-e9b7385133b6 req-c447cb25-9da9-4e24-920c-06e6c030980a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:54:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c875f4e3-efa0-4528-b672-e9b7385133b6 req-c447cb25-9da9-4e24-920c-06e6c030980a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:54:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c875f4e3-efa0-4528-b672-e9b7385133b6 req-c447cb25-9da9-4e24-920c-06e6c030980a tempest-AttachVolumeTestJSON-652029681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-2ef05efa-c157-4405-bddd-adf1655a2165', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a4c2006e-1129-4820-9307-0e169a3b09e4', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:54:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c875f4e3-efa0-4528-b672-e9b7385133b6 req-c447cb25-9da9-4e24-920c-06e6c030980a tempest-AttachVolumeTestJSON-652029681 None] attachment_update completed successfully.
Sep 04 05:55:06 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:55:06 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:12 devstack sudo[89737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:55:12 devstack sudo[89737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:55:12 devstack sudo[89737]: pam_unix(sudo:session): session closed for user root
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:55:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:55:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Flow 'volume_create_manager' (1007898d-3a8f-476b-ac33-1669760d028a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11d7ad9-07e7-4320-8041-a6152ea03944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11d7ad9-07e7-4320-8041-a6152ea03944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351313836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb5fcba-5245-4d6d-a101-af15713845dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd2e22bee3243089add6901da263694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:24Z,use_quota=True,user_id='f5415e8c29f347b8aded85d7ef12bdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5cb3ed-e091-40ab-ba4a-bd2d31e5f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca5cb3ed-e091-40ab-ba4a-bd2d31e5f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1608777a-a50d-4d03-bd86-4682c3ced134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1608777a-a50d-4d03-bd86-4682c3ced134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb5fcba-5245-4d6d-a101-af15713845dd', 'volume_name': 'volume-cfb5fcba-5245-4d6d-a101-af15713845dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59d69d-7c7b-4416-a20f-01f3f0cc5dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d59d69d-7c7b-4416-a20f-01f3f0cc5dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01daab55-a8e3-42b7-a3a6-be79b8bf5c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Volume cfb5fcba-5245-4d6d-a101-af15713845dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb5fcba-5245-4d6d-a101-af15713845dd', 'volume_size': 1}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351313836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb5fcba-5245-4d6d-a101-af15713845dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dd2e22bee3243089add6901da263694',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:24Z,use_quota=True,user_id='f5415e8c29f347b8aded85d7ef12bdfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Creating volume cfb5fcba-5245-4d6d-a101-af15713845dd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:55:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:55:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:24 devstack sudo[90315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd 1073741824
Sep 04 05:55:24 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:55:25 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root
Sep 04 05:55:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd 1073741824" returned: 0 in 0.906s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:55:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:25 devstack sudo[90333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd
Sep 04 05:55:25 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:55:26 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd" returned: 0 in 0.600s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01daab55-a8e3-42b7-a3a6-be79b8bf5c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb5fcba-5245-4d6d-a101-af15713845dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a60af31-8ff3-4e5b-a564-5e799081b77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Volume volume-cfb5fcba-5245-4d6d-a101-af15713845dd (cfb5fcba-5245-4d6d-a101-af15713845dd): created successfully
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a60af31-8ff3-4e5b-a564-5e799081b77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Flow 'volume_create_manager' (1007898d-3a8f-476b-ac33-1669760d028a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:55:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a44fb99d-ef89-47e2-b36a-35bc5a2ed178 tempest-TaggedAttachmentsTest-1416696974 None] Created volume successfully.
Sep 04 05:55:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:55:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:55:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-b375efdf-c99b-468b-92c2-2e48265a219a req-8ee3c3a7-5a96-4513-b44d-b059acbd14fe tempest-AttachVolumeTestJSON-652029681 None] Terminate volume connection completed successfully.
Sep 04 05:55:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-b375efdf-c99b-468b-92c2-2e48265a219a req-8ee3c3a7-5a96-4513-b44d-b059acbd14fe tempest-AttachVolumeTestJSON-652029681 None] Deleting attachment a4c2006e-1129-4820-9307-0e169a3b09e4. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:55:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Flow 'volume_create_manager' (d0d5c77f-f2fd-40bd-9b9b-614d64112bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45356274-823c-4bd8-9b27-90a164dcab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45356274-823c-4bd8-9b27-90a164dcab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-443277294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1762cc7-cdf7-4c3d-b8b1-86e868220ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5efd9aac5984ba2920d6ef85c6d752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:54Z,use_quota=True,user_id='a2403e74f204455b9fa7f3dc9884e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f315f45-f67a-48b7-beb5-6e080548b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f315f45-f67a-48b7-beb5-6e080548b14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b3af08-386e-4c25-bcb0-017dd13580e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24b3af08-386e-4c25-bcb0-017dd13580e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1762cc7-cdf7-4c3d-b8b1-86e868220ea4', 'volume_name': 'volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31775b9-e460-4daa-a632-87f00b75c4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c31775b9-e460-4daa-a632-87f00b75c4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1149ecf-a66c-48a3-9551-9e7084ae8f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Volume f1762cc7-cdf7-4c3d-b8b1-86e868220ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4', 'volume_size': 1}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-443277294',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1762cc7-cdf7-4c3d-b8b1-86e868220ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5efd9aac5984ba2920d6ef85c6d752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:55:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:55:54Z,use_quota=True,user_id='a2403e74f204455b9fa7f3dc9884e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Creating volume f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:55:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:55:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:54 devstack sudo[90672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 1073741824
Sep 04 05:55:54 devstack sudo[90672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:55:55 devstack sudo[90672]: pam_unix(sudo:session): session closed for user root
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 1073741824" returned: 0 in 0.915s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:55 devstack sudo[90699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4
Sep 04 05:55:55 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:55:55 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1149ecf-a66c-48a3-9551-9e7084ae8f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cad417-a070-456b-9733-847a971469b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Volume volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 (f1762cc7-cdf7-4c3d-b8b1-86e868220ea4): created successfully
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82cad417-a070-456b-9733-847a971469b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Flow 'volume_create_manager' (d0d5c77f-f2fd-40bd-9b9b-614d64112bae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:55:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ebc418ef-e487-442a-a93a-a9283d8457c1 tempest-ServersNegativeTestJSON-237431712 None] Created volume successfully.
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Flow 'volume_create_manager' (537aff89-0c04-4985-a6c4-22ae4228658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3766ea-0e1f-48d1-b268-ca4fab17579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e3766ea-0e1f-48d1-b268-ca4fab17579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-264772618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c810c55a-9029-4fdb-9248-20741bb92bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5efd9aac5984ba2920d6ef85c6d752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:00Z,use_quota=True,user_id='a2403e74f204455b9fa7f3dc9884e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbcae07-4a02-4002-a4cb-b88f30ae5945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cbcae07-4a02-4002-a4cb-b88f30ae5945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c70de4b-4a0e-406a-ae8b-2d4f1081544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c70de4b-4a0e-406a-ae8b-2d4f1081544a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c810c55a-9029-4fdb-9248-20741bb92bcb', 'volume_name': 'volume-c810c55a-9029-4fdb-9248-20741bb92bcb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e5fbb7-a63f-4047-8ff7-1793119b7f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e5fbb7-a63f-4047-8ff7-1793119b7f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5dbc5c-4243-46bb-86fb-9164f030ca53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:55:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Volume c810c55a-9029-4fdb-9248-20741bb92bcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c810c55a-9029-4fdb-9248-20741bb92bcb', 'volume_size': 1}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:55:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-264772618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c810c55a-9029-4fdb-9248-20741bb92bcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5efd9aac5984ba2920d6ef85c6d752a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:00Z,use_quota=True,user_id='a2403e74f204455b9fa7f3dc9884e1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Creating volume c810c55a-9029-4fdb-9248-20741bb92bcb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:55:59 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:55:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:55:59 devstack sudo[90796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb 1073741824
Sep 04 05:55:59 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:00 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb 1073741824" returned: 0 in 0.966s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:00 devstack sudo[90846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb
Sep 04 05:56:00 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:01 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5dbc5c-4243-46bb-86fb-9164f030ca53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c810c55a-9029-4fdb-9248-20741bb92bcb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db07d128-2547-4558-bcbc-b67678de015d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Volume volume-c810c55a-9029-4fdb-9248-20741bb92bcb (c810c55a-9029-4fdb-9248-20741bb92bcb): created successfully
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db07d128-2547-4558-bcbc-b67678de015d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Flow 'volume_create_manager' (537aff89-0c04-4985-a6c4-22ae4228658c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:56:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-72333553-bb0e-4835-a5a6-cebaf2baaa9c tempest-ServersNegativeTestJSON-237431712 None] Created volume successfully.
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "cinder-c810c55a-9029-4fdb-9248-20741bb92bcb-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-c810c55a-9029-4fdb-9248-20741bb92bcb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "cinder-quobyte-c810c55a-9029-4fdb-9248-20741bb92bcb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-quobyte-c810c55a-9029-4fdb-9248-20741bb92bcb" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d26f11-6540-4914-b490-15bbd4b2c7b5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:02 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb
Sep 04 05:56:02 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:02 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb" returned: 0 in 0.462s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:02 devstack sudo[90861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb
Sep 04 05:56:02 devstack sudo[90861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:03 devstack sudo[90861]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c810c55a-9029-4fdb-9248-20741bb92bcb" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-quobyte-c810c55a-9029-4fdb-9248-20741bb92bcb" released by "delete_volume" :: held 1.082s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Created reservations ['39c120ac-2acc-4ded-99f8-563f409e6cfb', '6b5f7d00-e4ec-49b6-a105-2889dce5ff8e', 'd643b2e6-4aa4-4a42-a346-1eb142868ed2', 'ca27b518-4d47-49f1-bd7f-378ee8bc0584'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:03 devstack sudo[90918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:56:03 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:04 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.616s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:56:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Deleted volume successfully.
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ace59a8-7536-4507-84da-ac7fdd91321c tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-c810c55a-9029-4fdb-9248-20741bb92bcb-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "cinder-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "cinder-quobyte-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-quobyte-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b9fa8c-5896-4922-a411-498b36c0df9f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:56:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:04 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4
Sep 04 05:56:04 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:05 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" returned: 0 in 0.456s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:05 devstack sudo[90939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4
Sep 04 05:56:05 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:05 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-quobyte-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4" released by "delete_volume" :: held 0.777s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Created reservations ['2a2e8d11-2229-407f-b7ce-7236102c920f', '1bcbbc63-52af-43cf-a5ea-54d9a3cb20f5', 'f8471f3f-f7e1-47a8-b414-21275ca3921c', '768769db-61a4-4c50-8632-c9322c91a2e8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:05 devstack sudo[90943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:56:05 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:06 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:56:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Deleted volume successfully.
Sep 04 05:56:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d0aaa14-4304-452e-9db7-3a72d2b9e27b tempest-ServersNegativeTestJSON-237431712 None] Lock "cinder-f1762cc7-cdf7-4c3d-b8b1-86e868220ea4-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:12 devstack sudo[90997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:56:12 devstack sudo[90997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:13 devstack sudo[90997]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.526s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:56:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:56:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 8 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:56:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:56:15 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=18,cinder:UPDATE=19,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:56:16 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=12,cinder:UPDATE=25,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:56:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c5b625fb-b250-44fe-86ae-da025e6e6103 req-a12381e0-1ed8-4b44-8d91-19a7fd346b24 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c5b625fb-b250-44fe-86ae-da025e6e6103 req-a12381e0-1ed8-4b44-8d91-19a7fd346b24 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c5b625fb-b250-44fe-86ae-da025e6e6103 req-a12381e0-1ed8-4b44-8d91-19a7fd346b24 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c5b625fb-b250-44fe-86ae-da025e6e6103 req-a12381e0-1ed8-4b44-8d91-19a7fd346b24 tempest-TaggedAttachmentsTest-1416696974 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-cfb5fcba-5245-4d6d-a101-af15713845dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fccd4ecd-2382-4165-a6b9-51c5d9a5ac31', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:56:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c5b625fb-b250-44fe-86ae-da025e6e6103 req-a12381e0-1ed8-4b44-8d91-19a7fd346b24 tempest-TaggedAttachmentsTest-1416696974 None] attachment_update completed successfully.
Sep 04 05:56:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-3935b3fa-6e0c-4d03-83d5-b8d2f4817c8d req-e14b8fa7-bb33-4d60-a386-9ea36f636401 tempest-TaggedAttachmentsTest-1416696974 None] Terminate volume connection completed successfully.
Sep 04 05:56:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-3935b3fa-6e0c-4d03-83d5-b8d2f4817c8d req-e14b8fa7-bb33-4d60-a386-9ea36f636401 tempest-TaggedAttachmentsTest-1416696974 None] Deleting attachment fccd4ecd-2382-4165-a6b9-51c5d9a5ac31. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:56:29 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=7 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Flow 'volume_create_manager' (4174c0a7-ac01-4d7d-a707-5443f0ad95aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c487e9c-9d52-48fc-b278-b373704ff229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c487e9c-9d52-48fc-b278-b373704ff229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1318945307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532a6b3-04f0-4a37-a586-506fc052b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8401d3a8112247678bd38537dc31fdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:32Z,use_quota=True,user_id='98802ce14cdb4cd5ab1a36068bc76864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299609f4-e045-4195-a2f1-8325a32c8724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (299609f4-e045-4195-a2f1-8325a32c8724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aec3932-d962-4926-b08c-dba3702816b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aec3932-d962-4926-b08c-dba3702816b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8532a6b3-04f0-4a37-a586-506fc052b656', 'volume_name': 'volume-8532a6b3-04f0-4a37-a586-506fc052b656', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e442082-3293-4680-a72e-22ff9b8c8098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e442082-3293-4680-a72e-22ff9b8c8098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec804ce-a296-4f3d-9bc3-9711c406d29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Volume 8532a6b3-04f0-4a37-a586-506fc052b656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8532a6b3-04f0-4a37-a586-506fc052b656', 'volume_size': 1}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1318945307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8532a6b3-04f0-4a37-a586-506fc052b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8401d3a8112247678bd38537dc31fdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:56:32Z,use_quota=True,user_id='98802ce14cdb4cd5ab1a36068bc76864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Creating volume 8532a6b3-04f0-4a37-a586-506fc052b656 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:56:32 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:56:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:32 devstack sudo[91625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 1073741824
Sep 04 05:56:32 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:33 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 1073741824" returned: 0 in 0.663s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:33 devstack sudo[91632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656
Sep 04 05:56:33 devstack sudo[91632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:33 devstack sudo[91632]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec804ce-a296-4f3d-9bc3-9711c406d29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8532a6b3-04f0-4a37-a586-506fc052b656', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e69e6dc-bb4e-4d7e-ba99-c9de52cb9bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:56:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Volume volume-8532a6b3-04f0-4a37-a586-506fc052b656 (8532a6b3-04f0-4a37-a586-506fc052b656): created successfully
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e69e6dc-bb4e-4d7e-ba99-c9de52cb9bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:56:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Flow 'volume_create_manager' (4174c0a7-ac01-4d7d-a707-5443f0ad95aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:56:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e56b7667-9254-4bf9-ae43-d0a6b94e8a58 tempest-ServerActionsTestOtherA-726427569 None] Created volume successfully.
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "cinder-cfb5fcba-5245-4d6d-a101-af15713845dd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "cinder-cfb5fcba-5245-4d6d-a101-af15713845dd-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "cinder-quobyte-cfb5fcba-5245-4d6d-a101-af15713845dd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "cinder-quobyte-cfb5fcba-5245-4d6d-a101-af15713845dd" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1c687d-4455-43f7-83e2-1f0d8b8234f0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:35 devstack sudo[91640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd
Sep 04 05:56:35 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:35 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:35 devstack sudo[91648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd
Sep 04 05:56:35 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:36 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfb5fcba-5245-4d6d-a101-af15713845dd" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "cinder-quobyte-cfb5fcba-5245-4d6d-a101-af15713845dd" released by "delete_volume" :: held 0.944s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Created reservations ['a1bbe60a-c6bd-4b96-8c6b-04f8961da91a', 'dc0568e5-cc6a-4891-9157-2a4b1f6d8f43', '05b77f9f-802e-41e0-9c2b-6d642a091e59', 'bfadf0a8-cc94-408e-8c84-907300176c21'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:56:36 devstack sudo[91674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:56:36 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:56:36 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:56:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Deleted volume successfully.
Sep 04 05:56:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69789df4-7a21-481a-837e-0384f93f8a11 tempest-TaggedAttachmentsTest-1416696974 None] Lock "cinder-cfb5fcba-5245-4d6d-a101-af15713845dd-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:56:46 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:56:46 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:57:03 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (f6a8b18e-7140-4042-b3f2-413d47dbd55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac687c0e-8f55-4095-999f-87df12014874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac687c0e-8f55-4095-999f-87df12014874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287057661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d649ec30-3c22-45d3-a6ee-42f0c3f7ed54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:04Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fc6026-2669-4621-925d-a2d0704d634f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85fc6026-2669-4621-925d-a2d0704d634f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00797452-4872-4f1e-8460-aef276639f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00797452-4872-4f1e-8460-aef276639f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd649ec30-3c22-45d3-a6ee-42f0c3f7ed54', 'volume_name': 'volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219e3365-1314-4f40-8912-64c9446d868d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (219e3365-1314-4f40-8912-64c9446d868d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bbfa26-b447-443f-92b8-dd1caeb75e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Volume d649ec30-3c22-45d3-a6ee-42f0c3f7ed54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54', 'volume_size': 1}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-287057661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d649ec30-3c22-45d3-a6ee-42f0c3f7ed54,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:04Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Creating volume d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:04 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:04 devstack sudo[91994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 1073741824
Sep 04 05:57:04 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:04 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 1073741824" returned: 0 in 0.588s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:04 devstack sudo[92000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54
Sep 04 05:57:04 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:05 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41bbfa26-b447-443f-92b8-dd1caeb75e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4fb173-45f0-4461-accc-6b54d4e9e9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Volume volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 (d649ec30-3c22-45d3-a6ee-42f0c3f7ed54): created successfully
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f4fb173-45f0-4461-accc-6b54d4e9e9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (f6a8b18e-7140-4042-b3f2-413d47dbd55a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f2935e3-82ac-4743-9920-401a3804ae52 tempest-VolumesTestJSON-853114885 None] Created volume successfully.
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (9edb1786-f679-44c8-ba29-0669f08b0551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba5bef-921c-47ba-95e6-3d9cc8025838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baba5bef-921c-47ba-95e6-3d9cc8025838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-188287178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2a5c9e-bcb1-4398-bbb2-82212074a5bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:07Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0bc936-8b50-4239-8f28-3f145ddffd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0bc936-8b50-4239-8f28-3f145ddffd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dcec03-a5ed-4a60-b16d-10acbfe545a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0dcec03-a5ed-4a60-b16d-10acbfe545a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc2a5c9e-bcb1-4398-bbb2-82212074a5bc', 'volume_name': 'volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31165dbe-3fe8-45cc-90e9-69fdefd7a017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31165dbe-3fe8-45cc-90e9-69fdefd7a017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a930780-5776-43cb-be7d-6a227537486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Volume dc2a5c9e-bcb1-4398-bbb2-82212074a5bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc', 'volume_size': 1}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-188287178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc2a5c9e-bcb1-4398-bbb2-82212074a5bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:07Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Creating volume dc2a5c9e-bcb1-4398-bbb2-82212074a5bc {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:06 devstack sudo[92006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc 1073741824
Sep 04 05:57:06 devstack sudo[92006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:07 devstack sudo[92006]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc 1073741824" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:07 devstack sudo[92025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc
Sep 04 05:57:07 devstack sudo[92025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:07 devstack sudo[92025]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a930780-5776-43cb-be7d-6a227537486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b82aeab-1748-4002-acfb-4d9341a690e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Volume volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc (dc2a5c9e-bcb1-4398-bbb2-82212074a5bc): created successfully
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b82aeab-1748-4002-acfb-4d9341a690e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (9edb1786-f679-44c8-ba29-0669f08b0551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-824728dd-dd1f-47a7-a445-499bdacc6106 tempest-VolumesTestJSON-853114885 None] Created volume successfully.
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (4c3f65ec-2672-449e-a558-5a7c503f7c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c4c40d-90c1-4158-bc10-30b4adc6ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12c4c40d-90c1-4158-bc10-30b4adc6ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397079902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef2986c-8a45-4130-8ac4-c0f2fce84814,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:09Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86d37a-0563-4604-978d-138ff1b56063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c86d37a-0563-4604-978d-138ff1b56063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd896c-10c6-4cc0-8d4c-174790d752a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acd896c-10c6-4cc0-8d4c-174790d752a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef2986c-8a45-4130-8ac4-c0f2fce84814', 'volume_name': 'volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b477edb0-70f9-42e6-ac33-e36dfef54a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b477edb0-70f9-42e6-ac33-e36dfef54a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eed3c1-06fe-4d32-a4a5-43bd699e2130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Volume 4ef2986c-8a45-4130-8ac4-c0f2fce84814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814', 'volume_size': 1}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1397079902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef2986c-8a45-4130-8ac4-c0f2fce84814,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9435d408799b41169f41873b69ec127a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:09Z,use_quota=True,user_id='aa981c5dbf294271bdd7970ebd09658b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Creating volume 4ef2986c-8a45-4130-8ac4-c0f2fce84814 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:09 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 1073741824
Sep 04 05:57:09 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:09 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 1073741824" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:09 devstack sudo[92034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814
Sep 04 05:57:09 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:10 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84eed3c1-06fe-4d32-a4a5-43bd699e2130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa09f1a-f647-4241-a71f-f1cb43874b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Volume volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 (4ef2986c-8a45-4130-8ac4-c0f2fce84814): created successfully
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa09f1a-f647-4241-a71f-f1cb43874b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Flow 'volume_create_manager' (4c3f65ec-2672-449e-a558-5a7c503f7c10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-373b49cc-b17e-44b1-bcde-8bb61b09a98b tempest-VolumesTestJSON-853114885 None] Created volume successfully.
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-4ef2986c-8a45-4130-8ac4-c0f2fce84814-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "cinder-4ef2986c-8a45-4130-8ac4-c0f2fce84814-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-quobyte-4ef2986c-8a45-4130-8ac4-c0f2fce84814" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-4ef2986c-8a45-4130-8ac4-c0f2fce84814" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bd4dd9-edfc-4bb0-b730-15129677586b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:11 devstack sudo[92038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814
Sep 04 05:57:11 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:11 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:11 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814
Sep 04 05:57:11 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:12 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4ef2986c-8a45-4130-8ac4-c0f2fce84814" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-4ef2986c-8a45-4130-8ac4-c0f2fce84814" released by "delete_volume" :: held 0.701s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Created reservations ['e8bebf04-a8e2-4f05-9193-791094a2fe9d', '2c19507b-8a14-4431-8f8b-ca036dbd7938', '086c7110-a66d-42b9-931b-b38053a3d864', '13e024b1-7825-4fdf-b526-2093cbc80fa9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:12 devstack sudo[92048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:12 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:12 devstack sudo[92052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:12 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "cinder-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:12 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Deleted volume successfully.
Sep 04 05:57:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-quobyte-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c72bc2f9-ed15-4364-915e-65d894905c47 tempest-VolumesTestJSON-853114885 None] Lock "cinder-4ef2986c-8a45-4130-8ac4-c0f2fce84814-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d9aa55-e573-4739-abdf-6410ae716806]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:13 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 8 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:57:13 devstack sudo[92066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc
Sep 04 05:57:13 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:13 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:13 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc
Sep 04 05:57:13 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:13 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc" released by "delete_volume" :: held 0.851s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Created reservations ['20da9137-4b37-4567-ad9b-7e8dcb01b26b', '4c23eb22-b7c1-4edb-b385-9ea8e2095109', '9341c3d0-7d78-4dab-a309-2dcac4c6190d', 'be83e9d5-b259-450a-9b34-0ede799cdb15'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:14 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:14 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:14 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Deleted volume successfully.
Sep 04 05:57:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b9afece3-b8e8-4a8e-a9cb-531f7b75469f tempest-VolumesTestJSON-853114885 None] Lock "cinder-dc2a5c9e-bcb1-4398-bbb2-82212074a5bc-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "cinder-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Acquiring lock "cinder-quobyte-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[16addc43-3977-41b6-beab-0739418a0859]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:15 devstack sudo[92104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54
Sep 04 05:57:15 devstack sudo[92104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:15 devstack sudo[92104]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:15 devstack sudo[92113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54
Sep 04 05:57:15 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:16 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "cinder-quobyte-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54" released by "delete_volume" :: held 0.791s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Created reservations ['10f967a2-038c-40bf-afd0-2eb92827d5cb', '3ed3b00b-cfed-4e32-8b46-102f14e9ae30', '7114ab05-638a-46be-90de-cf09af0e9f8e', '9b049e60-c5d9-4b71-966e-8e54adcdeb5c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:16 devstack sudo[92125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:16 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c58bf323-267a-47be-9f09-afebac7b5f62 req-bd7f07c5-0f96-4258-9701-b1447b8b6576 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c58bf323-267a-47be-9f09-afebac7b5f62 req-bd7f07c5-0f96-4258-9701-b1447b8b6576 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c58bf323-267a-47be-9f09-afebac7b5f62 req-bd7f07c5-0f96-4258-9701-b1447b8b6576 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c58bf323-267a-47be-9f09-afebac7b5f62 req-bd7f07c5-0f96-4258-9701-b1447b8b6576 tempest-ServerActionsTestOtherA-726427569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-8532a6b3-04f0-4a37-a586-506fc052b656', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03cc79e6-9e09-460e-90fa-aab7e2edf0d1', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:57:16 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c58bf323-267a-47be-9f09-afebac7b5f62 req-bd7f07c5-0f96-4258-9701-b1447b8b6576 tempest-ServerActionsTestOtherA-726427569 None] attachment_update completed successfully.
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Deleted volume successfully.
Sep 04 05:57:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1f12528a-0c20-47db-9e72-f9abd16c8013 tempest-VolumesTestJSON-853114885 None] Lock "cinder-d649ec30-3c22-45d3-a6ee-42f0c3f7ed54-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Flow 'volume_create_manager' (88337bc8-1c23-4f92-9601-86bdd531062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387d024-23e9-45c5-b8f4-888024ce2a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5387d024-23e9-45c5-b8f4-888024ce2a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-813197226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2becb5-de5a-4763-bec9-4f509ff626f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe980dcd8a14cdd866eaf2007178a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:18Z,use_quota=True,user_id='0b82af3cc8784446932f6320d30317e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8c72f-7ca9-4907-a89c-a2e177f6495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb8c72f-7ca9-4907-a89c-a2e177f6495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f3086-50e2-4d7c-a4d0-a78ddda6ccc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134f3086-50e2-4d7c-a4d0-a78ddda6ccc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa2becb5-de5a-4763-bec9-4f509ff626f6', 'volume_name': 'volume-fa2becb5-de5a-4763-bec9-4f509ff626f6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbbd237-0d0b-4f92-8948-cbb1204cbe88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acbbd237-0d0b-4f92-8948-cbb1204cbe88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fea1b7-b021-4dfb-9218-95038fbe3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Volume fa2becb5-de5a-4763-bec9-4f509ff626f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa2becb5-de5a-4763-bec9-4f509ff626f6', 'volume_size': 1}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-813197226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa2becb5-de5a-4763-bec9-4f509ff626f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fe980dcd8a14cdd866eaf2007178a5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:18Z,use_quota=True,user_id='0b82af3cc8784446932f6320d30317e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Creating volume fa2becb5-de5a-4763-bec9-4f509ff626f6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:18 devstack sudo[92533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 1073741824
Sep 04 05:57:18 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:18 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 1073741824" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:18 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6
Sep 04 05:57:18 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:19 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19fea1b7-b021-4dfb-9218-95038fbe3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa2becb5-de5a-4763-bec9-4f509ff626f6', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4f5649-54df-4863-b529-f5f72cb361e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Volume volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 (fa2becb5-de5a-4763-bec9-4f509ff626f6): created successfully
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c4f5649-54df-4863-b529-f5f72cb361e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Flow 'volume_create_manager' (88337bc8-1c23-4f92-9601-86bdd531062e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b67f4b37-491c-47c5-8c47-e383e03fccc7 tempest-AttachVolumeShelveTestJSON-1042161372 None] Created volume successfully.
Sep 04 05:57:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-a95b0124-aa91-4a5f-91d2-346be67d5b34 tempest-ServerActionsTestOtherA-726427569 None] Terminate volume connection completed successfully.
Sep 04 05:57:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-a95b0124-aa91-4a5f-91d2-346be67d5b34 tempest-ServerActionsTestOtherA-726427569 None] Deleting attachment 03cc79e6-9e09-460e-90fa-aab7e2edf0d1. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:57:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2cb42ed1-8cad-4f5c-adf1-5ba7cbe5e51a tempest-GroupsV314Test-1756267964 None] Group tempest-GroupsV314Test-Group-1291592011: creating
Sep 04 05:57:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-c4083405-533e-4049-810c-89cfc3bda174 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-c4083405-533e-4049-810c-89cfc3bda174 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-c4083405-533e-4049-810c-89cfc3bda174 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2cb42ed1-8cad-4f5c-adf1-5ba7cbe5e51a tempest-GroupsV314Test-1756267964 None] Group tempest-GroupsV314Test-Group-1291592011: created successfully
Sep 04 05:57:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2cb42ed1-8cad-4f5c-adf1-5ba7cbe5e51a tempest-GroupsV314Test-1756267964 None] Create group completed successfully.
Sep 04 05:57:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-c4083405-533e-4049-810c-89cfc3bda174 tempest-ServerActionsTestOtherA-726427569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-8532a6b3-04f0-4a37-a586-506fc052b656', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d157d7e-c3fc-4cbb-a2b0-42101d51becd', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:57:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-a69e5cff-f4cf-4cde-bb46-d22b79cdb81a req-c4083405-533e-4049-810c-89cfc3bda174 tempest-ServerActionsTestOtherA-726427569 None] attachment_update completed successfully.
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Flow 'volume_create_manager' (9abc4517-f5ab-475a-b7a2-48fa058bb7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c04a1b-1f70-4eec-a632-883d9b84dce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6c04a1b-1f70-4eec-a632-883d9b84dce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-234630889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1d9d909-58e5-40bd-a50a-821a84db1b99,host='devstack@QuobyteHD#QuobyteHD',id=36ffe609-24d5-4948-b3d6-2f30e055ce9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374d827d4c9c4c19a0840e5b95cbb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:23Z,use_quota=True,user_id='95af23030ed5471c89cb7ac099329ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23305cc4-c1bc-4eb0-8028-ad4e0e40c11a),volume_type_id=23305cc4-c1bc-4eb0-8028-ad4e0e40c11a)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89162466-2f60-435a-ba14-1c64fa0ce3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89162466-2f60-435a-ba14-1c64fa0ce3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23acbd-75ef-4320-b6e9-27d15e8cdf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc23acbd-75ef-4320-b6e9-27d15e8cdf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36ffe609-24d5-4948-b3d6-2f30e055ce9a', 'volume_name': 'volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f521b-14ca-48eb-a5d2-8579a7f640ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec6f521b-14ca-48eb-a5d2-8579a7f640ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a71348-831c-459b-a57c-96fda9fb42cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Volume 36ffe609-24d5-4948-b3d6-2f30e055ce9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a', 'volume_size': 1}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c1d9d909-58e5-40bd-a50a-821a84db1b99,created_at=2026-09-04T03:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-234630889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c1d9d909-58e5-40bd-a50a-821a84db1b99,host='devstack@QuobyteHD#QuobyteHD',id=36ffe609-24d5-4948-b3d6-2f30e055ce9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='374d827d4c9c4c19a0840e5b95cbb7e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:23Z,use_quota=True,user_id='95af23030ed5471c89cb7ac099329ebd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23305cc4-c1bc-4eb0-8028-ad4e0e40c11a),volume_type_id=23305cc4-c1bc-4eb0-8028-ad4e0e40c11a)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Creating volume 36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:23 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:23 devstack sudo[92750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a 1073741824
Sep 04 05:57:23 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:24 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a 1073741824" returned: 0 in 0.734s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:24 devstack sudo[93099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:24 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:24 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a71348-831c-459b-a57c-96fda9fb42cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f0578-b5eb-4834-80a9-83be6050a550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Volume volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a (36ffe609-24d5-4948-b3d6-2f30e055ce9a): created successfully
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c49f0578-b5eb-4834-80a9-83be6050a550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Flow 'volume_create_manager' (9abc4517-f5ab-475a-b7a2-48fa058bb7e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9ea70d2-960e-4b64-9713-ccff90ddaf85 tempest-GroupsV314Test-1756267964 None] Created volume successfully.
Sep 04 05:57:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Cloning volume 36ffe609-24d5-4948-b3d6-2f30e055ce9a to volume c644ee1e-67df-4ddf-bfea-290bb4917f8e
Sep 04 05:57:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Creating offline snapshot 4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 of volume 36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:57:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881a523-3b57-4f2e-acd3-f3c27b8a3f9f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:27 devstack sudo[93108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:27 devstack sudo[93108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:27 devstack sudo[93108]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.637s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:27 devstack sudo[93115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 1G
Sep 04 05:57:27 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:28 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 1G" returned: 0 in 0.634s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:28 devstack sudo[93121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:28 devstack sudo[93121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (7ec041dd-d601-4eff-b838-ffec2009dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a736472f-3937-4cac-b782-9f2668d0af76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a736472f-3937-4cac-b782-9f2668d0af76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1876039976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f683188f-72fd-42c1-a358-e7989107f4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:28Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4081dbc-6e00-483d-9f2d-9b4a33d73ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4081dbc-6e00-483d-9f2d-9b4a33d73ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b7c664-37a9-4df4-9a8e-1c36bcc6003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76b7c664-37a9-4df4-9a8e-1c36bcc6003c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f683188f-72fd-42c1-a358-e7989107f4c1', 'volume_name': 'volume-f683188f-72fd-42c1-a358-e7989107f4c1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbe4296-0387-42db-ac5d-84171ac846b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbe4296-0387-42db-ac5d-84171ac846b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a3732a-751c-408b-9087-648a94b04a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Volume f683188f-72fd-42c1-a358-e7989107f4c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f683188f-72fd-42c1-a358-e7989107f4c1', 'volume_size': 1}
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:28 devstack sudo[93121]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:57:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:28 devstack sudo[93128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:28 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:29 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:29 devstack sudo[93131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info
Sep 04 05:57:29 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:29 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:29 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:29 devstack sudo[93148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info
Sep 04 05:57:29 devstack sudo[93148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:29 devstack sudo[93148]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.info" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Acquiring lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] snapshot: 4722e6c8-37ef-4343-b3e1-caf4c98aa9d0, volume: c644ee1e-67df-4ddf-bfea-290bb4917f8e,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[509e97f3-3d79-4f64-ba24-bae8e8bb4053]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:29 devstack sudo[93153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:29 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:30 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.616s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ad5e2-2ce5-4bee-8a9c-24203a1c76cc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:30 devstack sudo[93177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:30 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:30 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 05:57:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:30 devstack sudo[93182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e
Sep 04 05:57:30 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-add322dc-4bc0-45da-86d2-418b46d0f464 req-1dd351e4-29af-4944-8496-504847386809 tempest-AttachVolumeShelveTestJSON-1042161372 None] No connector for attachment b66d4046-5c6e-4c34-8d96-9245323ddf7d; skipping storage backend terminate_connection call. {{(pid=87095) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Sep 04 05:57:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-add322dc-4bc0-45da-86d2-418b46d0f464 req-1dd351e4-29af-4944-8496-504847386809 tempest-AttachVolumeShelveTestJSON-1042161372 None] Deleting attachment b66d4046-5c6e-4c34-8d96-9245323ddf7d. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:57:36 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e" returned: 0 in 6.008s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:36 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 05:57:36 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Converted 1024.00 MB image at 170.41 MB/s
Sep 04 05:57:36 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:57:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:36 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e
Sep 04 05:57:36 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:37 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" released by "_copy_volume_from_snapshot" :: held 7.384s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Acquiring lock "cinder-quobyte-4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Deleting offline snapshot 4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 of volume 36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] snapshot_file for this snap is: volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[761c5f79-c3df-4725-8fce-620d688910e4]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:37 devstack sudo[93216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:37 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:37 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b18e9ae-5f8a-4af1-a8a8-4c591b63f840]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:37 devstack sudo[93221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:37 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:38 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.706s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:38 devstack sudo[93228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:38 devstack sudo[93228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:38 devstack sudo[93228]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:38 devstack sudo[93233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0
Sep 04 05:57:38 devstack sudo[93233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:39 devstack sudo[93233]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a.4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-4722e6c8-37ef-4343-b3e1-caf4c98aa9d0" released by "_delete_snapshot" :: held 1.969s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.249s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.587s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1876039976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f683188f-72fd-42c1-a358-e7989107f4c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:28Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Creating volume f683188f-72fd-42c1-a358-e7989107f4c1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:39 devstack sudo[93236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 1073741824
Sep 04 05:57:39 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b11780a5-974a-41aa-907a-8aea1c14af1c tempest-GroupsV314Test-1756267964 None] Create group from source-group-c1d9d909-58e5-40bd-a50a-821a84db1b99 completed successfully.
Sep 04 05:57:39 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 1073741824" returned: 0 in 0.541s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:39 devstack sudo[93242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1
Sep 04 05:57:39 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:40 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a3732a-751c-408b-9087-648a94b04a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f683188f-72fd-42c1-a358-e7989107f4c1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9c9a7-4cd3-4765-bd51-e0740259f195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Volume volume-f683188f-72fd-42c1-a358-e7989107f4c1 (f683188f-72fd-42c1-a358-e7989107f4c1): created successfully
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18e9c9a7-4cd3-4765-bd51-e0740259f195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (7ec041dd-d601-4eff-b838-ffec2009dc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d54a12b5-0fe7-489d-8f58-7041b89fe31a tempest-AttachVolumeTestJSON-652029681 None] Created volume successfully.
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Acquiring lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc344b66-ef6a-4773-882a-1a376c751730]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:41 devstack sudo[93276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e
Sep 04 05:57:41 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:41 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:41 devstack sudo[93289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e
Sep 04 05:57:41 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5c025bd1-6eed-41a8-a50e-4798b4805ea0 req-b0c205be-f8ea-4ab2-bf3b-edb0ae0323bf tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5c025bd1-6eed-41a8-a50e-4798b4805ea0 req-b0c205be-f8ea-4ab2-bf3b-edb0ae0323bf tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5c025bd1-6eed-41a8-a50e-4798b4805ea0 req-b0c205be-f8ea-4ab2-bf3b-edb0ae0323bf tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-5c025bd1-6eed-41a8-a50e-4798b4805ea0 req-b0c205be-f8ea-4ab2-bf3b-edb0ae0323bf tempest-AttachVolumeTestJSON-652029681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-f683188f-72fd-42c1-a358-e7989107f4c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf593a52-b14c-49c9-86b4-ed4fef62e9a4', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:57:42 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c644ee1e-67df-4ddf-bfea-290bb4917f8e" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-c644ee1e-67df-4ddf-bfea-290bb4917f8e" released by "delete_volume" :: held 0.936s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-5c025bd1-6eed-41a8-a50e-4798b4805ea0 req-b0c205be-f8ea-4ab2-bf3b-edb0ae0323bf tempest-AttachVolumeTestJSON-652029681 None] attachment_update completed successfully.
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Created reservations ['b5963efe-6068-4392-a853-6fd2d938eff2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:42 devstack cinder-volume[87095]: WARNING cinder.quota [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-906293443 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-906293443, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:57:42 devstack cinder-volume[87095]: WARNING cinder.quota [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-906293443 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-906293443, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Created reservations ['09c6764f-4531-4f19-96fd-855b7e00e73e', '3b771323-04b0-4845-94aa-5d74dabbf8f4', 'e0204f2e-36d4-4d03-ac19-45d802b98990', '830e3e9d-d3eb-43ff-a604-b6ec3e93d90d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:42 devstack sudo[93295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:42 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:42 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bd20af3e-e67f-46fd-93fc-62e03e730a0f tempest-GroupsV314Test-1756267964 None] Delete group completed successfully.
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Acquiring lock "cinder-quobyte-36ffe609-24d5-4948-b3d6-2f30e055ce9a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-36ffe609-24d5-4948-b3d6-2f30e055ce9a" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a74b52-d367-4481-9798-57834618e534]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:57:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:43 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:43 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:43 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:43 devstack sudo[93340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a
Sep 04 05:57:43 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:43 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-36ffe609-24d5-4948-b3d6-2f30e055ce9a" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Lock "cinder-quobyte-36ffe609-24d5-4948-b3d6-2f30e055ce9a" released by "delete_volume" :: held 0.740s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Created reservations ['c97a1327-3e6e-4f0b-aac4-9da47d48c244'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Created reservations ['911fd1d5-dc86-412a-9513-866d6f1880aa', 'c4c57d1b-d903-4c3e-b301-2fb331072850', '9bd413c6-752f-4be5-a53c-d886af087e3e', '136c290c-9758-4100-ad95-a77677c5457a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:43 devstack sudo[93355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:43 devstack sudo[93355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:44 devstack sudo[93355]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4ad9e3aa-13e0-41f9-8fdc-b2aaf08e466f tempest-GroupsV314Test-1756267964 None] Delete group completed successfully.
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (7d745320-e883-4b58-b332-b4be38dcdca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226b217-cb79-4de4-a0ee-99524eedf391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8226b217-cb79-4de4-a0ee-99524eedf391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1410972957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c81a5-8acf-4305-8ea6-89d161bcf8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:44Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fd6bc-9ca1-41d7-8cd5-6d563a4fe057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (976fd6bc-9ca1-41d7-8cd5-6d563a4fe057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5387a140-7421-4517-a74c-7580dad24c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5387a140-7421-4517-a74c-7580dad24c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '879c81a5-8acf-4305-8ea6-89d161bcf8f0', 'volume_name': 'volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7c9449-7e41-491f-8d91-b9a2c55113d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad7c9449-7e41-491f-8d91-b9a2c55113d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51023bd6-6754-423c-9d18-66da9d000396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Volume 879c81a5-8acf-4305-8ea6-89d161bcf8f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0', 'volume_size': 1}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1410972957',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=879c81a5-8acf-4305-8ea6-89d161bcf8f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4990cacacd5404c94252c4c163a3df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:57:44Z,use_quota=True,user_id='e77af8405f244bfc861dfc289f98c8b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Creating volume 879c81a5-8acf-4305-8ea6-89d161bcf8f0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:57:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:57:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:44 devstack sudo[93365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 1073741824
Sep 04 05:57:44 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:45 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 1073741824" returned: 0 in 0.504s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:45 devstack sudo[93371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0
Sep 04 05:57:45 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:45 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51023bd6-6754-423c-9d18-66da9d000396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d24e67b-67a4-4447-9593-1b1ffaa1e0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:57:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Volume volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 (879c81a5-8acf-4305-8ea6-89d161bcf8f0): created successfully
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d24e67b-67a4-4447-9593-1b1ffaa1e0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:57:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Flow 'volume_create_manager' (7d745320-e883-4b58-b332-b4be38dcdca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:57:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c71ad99a-5c76-44b9-a499-37dff296262a tempest-AttachVolumeTestJSON-652029681 None] Created volume successfully.
Sep 04 05:57:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1598f24d-5b32-46a4-bd29-6ccec34e61da req-e52aef2d-060c-4521-bc5b-da711cf58ffc tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1598f24d-5b32-46a4-bd29-6ccec34e61da req-e52aef2d-060c-4521-bc5b-da711cf58ffc tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1598f24d-5b32-46a4-bd29-6ccec34e61da req-e52aef2d-060c-4521-bc5b-da711cf58ffc tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-1598f24d-5b32-46a4-bd29-6ccec34e61da req-e52aef2d-060c-4521-bc5b-da711cf58ffc tempest-AttachVolumeTestJSON-652029681 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aeec1600-d582-4094-b73b-c7d134101529', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:57:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-1598f24d-5b32-46a4-bd29-6ccec34e61da req-e52aef2d-060c-4521-bc5b-da711cf58ffc tempest-AttachVolumeTestJSON-652029681 None] attachment_update completed successfully.
Sep 04 05:57:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6c8c6dd9-3bc1-4a72-b16b-fb9fe16c22a1 req-13f0e47b-a410-4b96-a711-d23ab1c31fc3 tempest-ServerActionsTestOtherA-726427569 None] Terminate volume connection completed successfully.
Sep 04 05:57:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6c8c6dd9-3bc1-4a72-b16b-fb9fe16c22a1 req-13f0e47b-a410-4b96-a711-d23ab1c31fc3 tempest-ServerActionsTestOtherA-726427569 None] Deleting attachment 2d157d7e-c3fc-4cbb-a2b0-42101d51becd. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:57:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-8666fe7a-8f5e-438e-9b55-1f10fae1a41e req-7c00f9f2-7885-4370-a4d1-ca23eaa5b7d7 tempest-AttachVolumeTestJSON-652029681 None] Terminate volume connection completed successfully.
Sep 04 05:57:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8666fe7a-8f5e-438e-9b55-1f10fae1a41e req-7c00f9f2-7885-4370-a4d1-ca23eaa5b7d7 tempest-AttachVolumeTestJSON-652029681 None] Deleting attachment bf593a52-b14c-49c9-86b4-ed4fef62e9a4. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:57:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f348c1f3-eed2-4283-8602-fc62a6e7abfe tempest-GroupsV320Test-1493565306 None] Group tempest-GroupsV320Test-Group-1779926049: creating
Sep 04 05:57:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f348c1f3-eed2-4283-8602-fc62a6e7abfe tempest-GroupsV320Test-1493565306 None] Group tempest-GroupsV320Test-Group-1779926049: created successfully
Sep 04 05:57:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f348c1f3-eed2-4283-8602-fc62a6e7abfe tempest-GroupsV320Test-1493565306 None] Create group completed successfully.
Sep 04 05:57:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-e428ca9b-8075-4f6e-8e30-91faed0665e8 req-6e8cec91-017b-468e-a877-6e6f629588c5 tempest-AttachVolumeTestJSON-652029681 None] Terminate volume connection completed successfully.
Sep 04 05:57:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-e428ca9b-8075-4f6e-8e30-91faed0665e8 req-6e8cec91-017b-468e-a877-6e6f629588c5 tempest-AttachVolumeTestJSON-652029681 None] Deleting attachment aeec1600-d582-4094-b73b-c7d134101529. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Created reservations ['82573950-12de-4500-844d-0952964ffeb1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:57:54 devstack sudo[93506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:57:54 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:57:54 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.462s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:57:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:57:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f932df3a-f42f-4ef4-84a0-06b6b2697c08 tempest-GroupsV320Test-1493565306 None] Delete group completed successfully.
Sep 04 05:57:59 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=82,cinder:UPDATE=85,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:57:59 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=103,cinder:UPDATE=78,cinder:DELETE=4,cinder:INSERT=13 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:57:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Flow 'volume_create_manager' (7b118f76-bba5-44b0-9807-69c76ccfce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e75a24-85b8-4da6-8ee0-97e85830956d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e75a24-85b8-4da6-8ee0-97e85830956d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1130380753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21180aca-204f-4eaa-8f67-0d54dae3799c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8401d3a8112247678bd38537dc31fdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:00Z,use_quota=True,user_id='98802ce14cdb4cd5ab1a36068bc76864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcc2eb4-8bc3-4d50-a23c-ff6885ddf535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdcc2eb4-8bc3-4d50-a23c-ff6885ddf535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b98bbc5-afe7-4ac4-821a-d6e5d3c49330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-879c81a5-8acf-4305-8ea6-89d161bcf8f0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-879c81a5-8acf-4305-8ea6-89d161bcf8f0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-quobyte-879c81a5-8acf-4305-8ea6-89d161bcf8f0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-879c81a5-8acf-4305-8ea6-89d161bcf8f0" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45109ef7-ff88-489d-8810-79ba6def0889]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:01 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0
Sep 04 05:58:01 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b98bbc5-afe7-4ac4-821a-d6e5d3c49330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21180aca-204f-4eaa-8f67-0d54dae3799c', 'volume_name': 'volume-21180aca-204f-4eaa-8f67-0d54dae3799c', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c278f0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786d5f72-7c12-45a8-9739-a13e44c22fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786d5f72-7c12-45a8-9739-a13e44c22fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4e9627-e797-4c9b-8fea-58c501f24c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Volume 21180aca-204f-4eaa-8f67-0d54dae3799c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21180aca-204f-4eaa-8f67-0d54dae3799c', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c278f0>}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Trying to clone 21180aca-204f-4eaa-8f67-0d54dae3799c from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 05:58:01 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0" returned: 0 in 0.501s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:01 devstack sudo[93562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0
Sep 04 05:58:01 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 05:58:01 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bab262-58e1-464c-bb64-a42cc989c0d9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:01 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-879c81a5-8acf-4305-8ea6-89d161bcf8f0" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-879c81a5-8acf-4305-8ea6-89d161bcf8f0" released by "delete_volume" :: held 0.924s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:01 devstack sudo[93565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD
Sep 04 05:58:01 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Created reservations ['26dcf982-c3fa-46b6-ad5b-4ce44db621d0', '9a22030d-d51a-48a1-9541-8e98af6e73ee', 'b5ec39dc-347c-4ca7-8785-8160444ca5df', 'dd627f45-111a-43fc-9531-2898ff5c6ca9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:01 devstack sudo[93568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:01 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:02 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 is fetched for user 98802ce14cdb4cd5ab1a36068bc76864. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcfe56b-faf9-47d2-86b3-4577c6e61c5e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:02 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Deleted volume successfully.
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-045c42db-8fa2-4657-bb57-5555c50f6e05 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-879c81a5-8acf-4305-8ea6-89d161bcf8f0-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:02 devstack sudo[93574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD
Sep 04 05:58:02 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:02 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1130380753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21180aca-204f-4eaa-8f67-0d54dae3799c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8401d3a8112247678bd38537dc31fdea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:00Z,use_quota=True,user_id='98802ce14cdb4cd5ab1a36068bc76864',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Creating volume 21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:58:02 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:02 devstack sudo[93579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1073741824
Sep 04 05:58:02 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-f683188f-72fd-42c1-a358-e7989107f4c1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-f683188f-72fd-42c1-a358-e7989107f4c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:03 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1073741824" returned: 0 in 0.520s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-quobyte-f683188f-72fd-42c1-a358-e7989107f4c1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-f683188f-72fd-42c1-a358-e7989107f4c1" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e91b91e-b521-4483-b030-9a2c92a10c3a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:03 devstack sudo[93585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c
Sep 04 05:58:03 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:03 devstack sudo[93586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1
Sep 04 05:58:03 devstack sudo[93586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:03 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Attempting download of c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 21180aca-204f-4eaa-8f67-0d54dae3799c. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1b988b-9ed5-44c5-b164-806b7c7a69a2]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:03 devstack sudo[93586]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1" returned: 0 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:03 devstack sudo[93591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f
Sep 04 05:58:03 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:03 devstack sudo[93595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1
Sep 04 05:58:03 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:03 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:03 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f683188f-72fd-42c1-a358-e7989107f4c1" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-f683188f-72fd-42c1-a358-e7989107f4c1" released by "delete_volume" :: held 0.795s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:03 devstack sudo[93600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f
Sep 04 05:58:03 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Created reservations ['2f197c8d-88d1-4485-890f-16ab7b020076', '1c3e2a99-6c92-462e-92be-fde43b3e370d', '893ba0d1-36e7-41ec-a257-a06b2cfdb003', '5cf0dc7d-6548-491f-9d30-703768aeb665'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:04 devstack sudo[93602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:04 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:04 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f" returned: 1 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_v9eh4z4f' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[474e95bc-0af7-40bd-b513-3fcc98b58e09]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-2ef05efa-c157-4405-bddd-adf1655a2165-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-2ef05efa-c157-4405-bddd-adf1655a2165-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:04 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.369s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:04 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD
Sep 04 05:58:04 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Deleted volume successfully.
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "cinder-quobyte-2ef05efa-c157-4405-bddd-adf1655a2165" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80eb2204-406a-4b0e-864c-d917a6fd25c4 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-f683188f-72fd-42c1-a358-e7989107f4c1-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-2ef05efa-c157-4405-bddd-adf1655a2165" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a121fb8c-4ee7-4a84-b113-762e5a2ac7e2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:04 devstack sudo[93609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165
Sep 04 05:58:04 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:04 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] c1c4afc1-734f-46ce-9589-8a0fba4d2421 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:04 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c
Sep 04 05:58:04 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:04 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:04 devstack sudo[93623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165
Sep 04 05:58:04 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:05 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ef05efa-c157-4405-bddd-adf1655a2165" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-quobyte-2ef05efa-c157-4405-bddd-adf1655a2165" released by "delete_volume" :: held 0.798s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Created reservations ['34696563-e95c-4bee-8110-5504d1738cc4', '80f3dd69-f33c-4b7d-9e72-bcefb503fea6', 'ec678e32-7538-4b3c-af72-dda921d389fe', '9acc0a74-4be7-430d-85dc-037a61563416'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:05 devstack sudo[93626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:05 devstack sudo[93626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:05 devstack sudo[93626]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.369s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Deleted volume successfully.
Sep 04 05:58:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3835c9ac-9ff0-4194-b5c8-7fcc8b46fdd1 tempest-AttachVolumeTestJSON-652029681 None] Lock "cinder-2ef05efa-c157-4405-bddd-adf1655a2165-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:07 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c" returned: 0 in 2.526s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_381u7pu7devstack@QuobyteHD, size 112.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 05:58:07 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Converted 112.00 MB image at 44.32 MB/s
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:07 devstack sudo[93631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1G
Sep 04 05:58:07 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:07 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c 1G" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Downloaded image c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 21180aca-204f-4eaa-8f67-0d54dae3799c successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 for user 98802ce14cdb4cd5ab1a36068bc76864 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Marking volume 21180aca-204f-4eaa-8f67-0d54dae3799c as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Copying metadata from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 to 21180aca-204f-4eaa-8f67-0d54dae3799c. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Creating volume glance metadata for volume 21180aca-204f-4eaa-8f67-0d54dae3799c backed by image c1c4afc1-734f-46ce-9589-8a0fba4d2421 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b4e9627-e797-4c9b-8fea-58c501f24c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21180aca-204f-4eaa-8f67-0d54dae3799c', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c278f0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f62e3c-7a33-4f43-af49-584dab2a2709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Volume volume-21180aca-204f-4eaa-8f67-0d54dae3799c (21180aca-204f-4eaa-8f67-0d54dae3799c): created successfully
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f62e3c-7a33-4f43-af49-584dab2a2709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Flow 'volume_create_manager' (7b118f76-bba5-44b0-9807-69c76ccfce70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-baadd0d6-978b-43a6-8435-cc3038d8a3ae tempest-ServerActionsTestOtherA-726427569 None] Created volume successfully.
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Flow 'volume_create_manager' (60f3f7ec-d901-415d-ba09-4f223cdc577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6beac-7d2e-4f09-bda6-ae4dac60576e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b6beac-7d2e-4f09-bda6-ae4dac60576e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-334740369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef5ae62-8216-45cb-b20d-040fca46c7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d053061c74e7aaa082bb9aedf0e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:11Z,use_quota=True,user_id='cf635af64f594f85852e1b5f0c9476a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cc7826-dd9d-4be6-9d8f-c2c951f79a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2cc7826-dd9d-4be6-9d8f-c2c951f79a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3161deb-7c18-4174-8e49-f7a0ef3aa72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3161deb-7c18-4174-8e49-f7a0ef3aa72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ef5ae62-8216-45cb-b20d-040fca46c7a7', 'volume_name': 'volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3d6d0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4173617-e56a-490b-aa16-89000d33e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4173617-e56a-490b-aa16-89000d33e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849fcc37-e7e3-4589-8985-8d19661d9a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3d6d0>}
Sep 04 05:58:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Trying to clone 6ef5ae62-8216-45cb-b20d-040fca46c7a7 from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 05:58:12 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ecb73-86ac-42ac-8bff-d47f536d2fbf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:12 devstack sudo[93674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD
Sep 04 05:58:12 devstack sudo[93674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:12 devstack sudo[93679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:12 devstack sudo[93679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:13 devstack sudo[93674]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:13 devstack sudo[93679]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 is fetched for user cf635af64f594f85852e1b5f0c9476a0. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.516s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d28b726-c585-4b02-8c01-4ac55a91846f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:13 devstack sudo[93692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD
Sep 04 05:58:13 devstack sudo[93692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:13 devstack sudo[93692]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD" returned: 0 in 0.632s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-334740369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ef5ae62-8216-45cb-b20d-040fca46c7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6d053061c74e7aaa082bb9aedf0e0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:11Z,use_quota=True,user_id='cf635af64f594f85852e1b5f0c9476a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Creating volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:58:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:58:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:13 devstack sudo[93698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1073741824
Sep 04 05:58:13 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-56cd5ebf-1080-41a1-9133-45df7deeb794 req-f8332d6e-376c-4f25-abd7-89fa0931b6c3 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:14 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1073741824" returned: 0 in 0.795s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:14 devstack sudo[93712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7
Sep 04 05:58:14 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:15 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-56cd5ebf-1080-41a1-9133-45df7deeb794 req-f8332d6e-376c-4f25-abd7-89fa0931b6c3 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.642s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-56cd5ebf-1080-41a1-9133-45df7deeb794 req-f8332d6e-376c-4f25-abd7-89fa0931b6c3 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Attempting download of c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-56cd5ebf-1080-41a1-9133-45df7deeb794 req-f8332d6e-376c-4f25-abd7-89fa0931b6c3 tempest-ServerActionsTestOtherA-726427569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-21180aca-204f-4eaa-8f67-0d54dae3799c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1f94d1f-fd4c-45f8-83ec-a513a1000a53', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e084b3ae-d977-483a-b8d2-a7be1e3d7352]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-56cd5ebf-1080-41a1-9133-45df7deeb794 req-f8332d6e-376c-4f25-abd7-89fa0931b6c3 tempest-ServerActionsTestOtherA-726427569 None] attachment_update completed successfully.
Sep 04 05:58:15 devstack sudo[93715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6
Sep 04 05:58:15 devstack sudo[93715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:15 devstack sudo[93715]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6" returned: 0 in 0.573s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:15 devstack sudo[93719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6
Sep 04 05:58:15 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:16 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6" returned: 1 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_ddt12_c6' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6e32f2-4f50-4693-a854-3e83991cccea]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:16 devstack sudo[93723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD
Sep 04 05:58:16 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Acquiring lock "cinder-fa2becb5-de5a-4763-bec9-4f509ff626f6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "cinder-fa2becb5-de5a-4763-bec9-4f509ff626f6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Acquiring lock "cinder-quobyte-fa2becb5-de5a-4763-bec9-4f509ff626f6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "cinder-quobyte-fa2becb5-de5a-4763-bec9-4f509ff626f6" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[694460f0-5a02-4ee8-a508-1d082ebcfeed]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:16 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] c1c4afc1-734f-46ce-9589-8a0fba4d2421 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 05:58:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:16 devstack sudo[93729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7
Sep 04 05:58:16 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:16 devstack sudo[93726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6
Sep 04 05:58:16 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:17 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6" returned: 0 in 0.558s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:17 devstack sudo[93739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6
Sep 04 05:58:17 devstack sudo[93739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:17 devstack sudo[93739]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fa2becb5-de5a-4763-bec9-4f509ff626f6" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "cinder-quobyte-fa2becb5-de5a-4763-bec9-4f509ff626f6" released by "delete_volume" :: held 1.010s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Created reservations ['f85b0ac7-3d8f-45fd-abe7-6894b5511c05', 'd2f08b27-9122-45c1-916d-f8b7903efca3', '56985e82-7b91-49c7-88eb-8db8cb8a222e', '45bb2620-3bc5-477b-9672-264d9879d817'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:17 devstack sudo[93744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:17 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:18 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Deleted volume successfully.
Sep 04 05:58:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a600379d-a85d-4e1c-9da8-f37d2ef6573e tempest-AttachVolumeShelveTestJSON-1042161372 None] Lock "cinder-fa2becb5-de5a-4763-bec9-4f509ff626f6-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:19 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7" returned: 0 in 3.013s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:19 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_k2ys59bxdevstack@QuobyteHD, size 112.00 MB, duration 3.01 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 05:58:19 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Converted 112.00 MB image at 37.16 MB/s
Sep 04 05:58:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:19 devstack sudo[94164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1G
Sep 04 05:58:19 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:20 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 1G" returned: 0 in 0.620s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Downloaded image c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 for user cf635af64f594f85852e1b5f0c9476a0 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Marking volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Copying metadata from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 to 6ef5ae62-8216-45cb-b20d-040fca46c7a7. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Creating volume glance metadata for volume 6ef5ae62-8216-45cb-b20d-040fca46c7a7 backed by image c1c4afc1-734f-46ce-9589-8a0fba4d2421 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849fcc37-e7e3-4589-8985-8d19661d9a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3d6d0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073fff91-6f15-4b94-b1f1-d03bc72a120b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Volume volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 (6ef5ae62-8216-45cb-b20d-040fca46c7a7): created successfully
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073fff91-6f15-4b94-b1f1-d03bc72a120b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Flow 'volume_create_manager' (60f3f7ec-d901-415d-ba09-4f223cdc577c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0a7f7adb-4581-4e7e-817e-17bbfa161bd7 tempest-VolumesImageMetadata-870289794 None] Created volume successfully.
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Acquiring lock "cinder-6ef5ae62-8216-45cb-b20d-040fca46c7a7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "cinder-6ef5ae62-8216-45cb-b20d-040fca46c7a7-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Acquiring lock "cinder-quobyte-6ef5ae62-8216-45cb-b20d-040fca46c7a7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "cinder-quobyte-6ef5ae62-8216-45cb-b20d-040fca46c7a7" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dea8be-5854-4bb8-94cb-df0f15515be8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:22 devstack sudo[94175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7
Sep 04 05:58:22 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:22 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:22 devstack sudo[94181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7
Sep 04 05:58:22 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:22 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6ef5ae62-8216-45cb-b20d-040fca46c7a7" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "cinder-quobyte-6ef5ae62-8216-45cb-b20d-040fca46c7a7" released by "delete_volume" :: held 0.992s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Created reservations ['ca93706f-4386-448a-b330-2b4204a40e83', '4dc1b99e-ffaa-4732-ada9-6ad3858afd5e', '07280269-d32f-4bbb-b788-dc8e5b39247c', '4cad2458-d9b7-410c-8bf7-97883e159787'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:23 devstack sudo[94184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:23 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:23 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.529s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Deleted volume successfully.
Sep 04 05:58:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26052fe4-6fb6-46f7-af89-68a7511ad398 tempest-VolumesImageMetadata-870289794 None] Lock "cinder-6ef5ae62-8216-45cb-b20d-040fca46c7a7-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Flow 'volume_create_manager' (3b13924c-c0fd-4074-a750-2a5ccda31212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066d5628-9adb-4f68-a002-1478060e360d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (066d5628-9adb-4f68-a002-1478060e360d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-971253949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511c39ee-f435-44f5-aac1-84c4dbaa82c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0926c87896401cbe7c30a2a423690c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:32Z,use_quota=True,user_id='1c3ce35916684ecaa152ad48b5ca05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d639f2-ba71-4cfd-8d83-7d9c64db05d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d639f2-ba71-4cfd-8d83-7d9c64db05d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b1f3fb-2767-4957-97e7-266ee303d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91b1f3fb-2767-4957-97e7-266ee303d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '511c39ee-f435-44f5-aac1-84c4dbaa82c4', 'volume_name': 'volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2107c297-a2b0-4cba-8e5f-6dfd762a6e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2107c297-a2b0-4cba-8e5f-6dfd762a6e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9790b6-cfc0-4bb6-bab7-858929c4b2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Volume 511c39ee-f435-44f5-aac1-84c4dbaa82c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4', 'volume_size': 1}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-971253949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=511c39ee-f435-44f5-aac1-84c4dbaa82c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf0926c87896401cbe7c30a2a423690c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:32Z,use_quota=True,user_id='1c3ce35916684ecaa152ad48b5ca05cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Creating volume 511c39ee-f435-44f5-aac1-84c4dbaa82c4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:58:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:58:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:32 devstack sudo[94231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 1073741824
Sep 04 05:58:32 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:32 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 1073741824" returned: 0 in 0.990s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:33 devstack sudo[94236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4
Sep 04 05:58:33 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:33 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4" returned: 0 in 0.732s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] <== create_volume: return (1823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b9790b6-cfc0-4bb6-bab7-858929c4b2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d937dc0d-e480-4f2a-9e57-0ce092fb1981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Volume volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 (511c39ee-f435-44f5-aac1-84c4dbaa82c4): created successfully
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d937dc0d-e480-4f2a-9e57-0ce092fb1981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Flow 'volume_create_manager' (3b13924c-c0fd-4074-a750-2a5ccda31212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-102a7b2e-2dfb-4bf2-b316-a0ffe42bb9d1 tempest-AbsoluteLimitsTests-1899425468 None] Created volume successfully.
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Acquiring lock "cinder-511c39ee-f435-44f5-aac1-84c4dbaa82c4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "cinder-511c39ee-f435-44f5-aac1-84c4dbaa82c4-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Acquiring lock "cinder-quobyte-511c39ee-f435-44f5-aac1-84c4dbaa82c4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "cinder-quobyte-511c39ee-f435-44f5-aac1-84c4dbaa82c4" acquired by "delete_volume" :: waited 0.057s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0002a69-1b4b-4d70-86de-155b59d30341]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:35 devstack sudo[94244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4
Sep 04 05:58:35 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:36 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4" returned: 0 in 0.724s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:36 devstack sudo[94250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4
Sep 04 05:58:36 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:37 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-511c39ee-f435-44f5-aac1-84c4dbaa82c4" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "cinder-quobyte-511c39ee-f435-44f5-aac1-84c4dbaa82c4" released by "delete_volume" :: held 1.287s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Created reservations ['9d290e27-42eb-4f98-8a52-7fcf4a5aa956', '00e75f99-7c53-46b1-add4-3196376b67a3', '0590618a-14f3-4119-bc44-a691e72ce4c9', '0bc7ca2f-ce9c-4bf0-8f9c-fb713fbc1853'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:37 devstack sudo[94257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:58:37 devstack sudo[94257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:37 devstack sudo[94257]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.575s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:58:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Deleted volume successfully.
Sep 04 05:58:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b227f3d5-48ed-4b89-ac68-635bdb43d1e1 tempest-AbsoluteLimitsTests-1899425468 None] Lock "cinder-511c39ee-f435-44f5-aac1-84c4dbaa82c4-delete_volume" released by "delete_volume" :: held 2.364s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:58:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-83d5f6cb-778d-4579-8fed-fe96903cb1ac tempest-ServerActionsTestOtherA-726427569 None] Terminate volume connection completed successfully.
Sep 04 05:58:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-83d5f6cb-778d-4579-8fed-fe96903cb1ac tempest-ServerActionsTestOtherA-726427569 None] Deleting attachment b1f94d1f-fd4c-45f8-83ec-a513a1000a53. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:58:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-372b11a3-a906-45c4-9eaf-bc52ebb466ca tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-372b11a3-a906-45c4-9eaf-bc52ebb466ca tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-372b11a3-a906-45c4-9eaf-bc52ebb466ca tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-372b11a3-a906-45c4-9eaf-bc52ebb466ca tempest-ServerActionsTestOtherA-726427569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-21180aca-204f-4eaa-8f67-0d54dae3799c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01f75ac4-97ef-4499-b5fe-e9da94819c06', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:58:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-36e47a96-2f6d-4ffb-b618-40dd46f8b97c req-372b11a3-a906-45c4-9eaf-bc52ebb466ca tempest-ServerActionsTestOtherA-726427569 None] attachment_update completed successfully.
Sep 04 05:58:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73ed4bef-f525-4404-a45e-a7f047516da9 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-1138620225: creating
Sep 04 05:58:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73ed4bef-f525-4404-a45e-a7f047516da9 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-1138620225: created successfully
Sep 04 05:58:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73ed4bef-f525-4404-a45e-a7f047516da9 tempest-GroupSnapshotsTest-899590123 None] Create group completed successfully.
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (bf2cd7de-6883-401e-8448-38458c37799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6022f0-bd71-46b9-9118-2255a4b7c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f6022f0-bd71-46b9-9118-2255a4b7c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1105994821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cf59ef-a35e-46da-9a44-a9a515d23e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c27be27e6654fb385cc393f81e17424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:47Z,use_quota=True,user_id='6e1e396a83bb468ca7af6f1f2b3af3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ffa45-8a76-42b2-bef3-f4c4b277bc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c87ffa45-8a76-42b2-bef3-f4c4b277bc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3ba63-60fd-4c8d-ba06-ea80fe260b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b3ba63-60fd-4c8d-ba06-ea80fe260b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7cf59ef-a35e-46da-9a44-a9a515d23e65', 'volume_name': 'volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6df69b8-7b87-46f7-ad1b-dc8923c4971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6df69b8-7b87-46f7-ad1b-dc8923c4971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68123d91-4948-403c-a2ba-be1ac8a26f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Volume e7cf59ef-a35e-46da-9a44-a9a515d23e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65', 'volume_size': 1}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1105994821',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7cf59ef-a35e-46da-9a44-a9a515d23e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c27be27e6654fb385cc393f81e17424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:47Z,use_quota=True,user_id='6e1e396a83bb468ca7af6f1f2b3af3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Creating volume e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:58:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:58:47 devstack sudo[94748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 1073741824
Sep 04 05:58:47 devstack sudo[94748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (64ee4aa0-b9c7-460f-b202-5730c9463d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76415c9-7ced-4ca8-870b-1fe16f109cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e76415c9-7ced-4ca8-870b-1fe16f109cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011848370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9754f2d-3dc8-4a4f-b11f-94fa4459c5c2,host='devstack@QuobyteHD#QuobyteHD',id=9359dea6-415f-4b48-a7d9-8a6f32ee14ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:47Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448255a-9b7c-468c-8378-4d2f3240aa3c),volume_type_id=1448255a-9b7c-468c-8378-4d2f3240aa3c)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aa3ca8-60f9-47f2-96c1-682fe6f369c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60aa3ca8-60f9-47f2-96c1-682fe6f369c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf75140-b4c7-4659-9130-0e7ba1a2c032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf75140-b4c7-4659-9130-0e7ba1a2c032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9359dea6-415f-4b48-a7d9-8a6f32ee14ac', 'volume_name': 'volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88b1522-55d5-4b04-abc4-f762f8f5b025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f88b1522-55d5-4b04-abc4-f762f8f5b025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c69c0-663a-48c4-88bb-8c3fcb808624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Volume 9359dea6-415f-4b48-a7d9-8a6f32ee14ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac', 'volume_size': 1}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:47 devstack sudo[94748]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 1073741824" returned: 0 in 0.679s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:47 devstack sudo[94756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65
Sep 04 05:58:47 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:48 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.093s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c9754f2d-3dc8-4a4f-b11f-94fa4459c5c2,created_at=2026-09-04T03:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2011848370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c9754f2d-3dc8-4a4f-b11f-94fa4459c5c2,host='devstack@QuobyteHD#QuobyteHD',id=9359dea6-415f-4b48-a7d9-8a6f32ee14ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:58:47Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1448255a-9b7c-468c-8378-4d2f3240aa3c),volume_type_id=1448255a-9b7c-468c-8378-4d2f3240aa3c)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Creating volume 9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:58:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68123d91-4948-403c-a2ba-be1ac8a26f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c5682c-016a-4434-93ed-cbb87be7b2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:48 devstack sudo[94760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac 1073741824
Sep 04 05:58:48 devstack sudo[94760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Volume volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 (e7cf59ef-a35e-46da-9a44-a9a515d23e65): created successfully
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c5682c-016a-4434-93ed-cbb87be7b2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (bf2cd7de-6883-401e-8448-38458c37799f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b05fe819-2f03-48a2-99fa-8e085d6d399b tempest-VolumesDeleteCascade-1379712238 None] Created volume successfully.
Sep 04 05:58:49 devstack sudo[94760]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac 1073741824" returned: 0 in 1.113s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:49 devstack sudo[94767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:58:49 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:50 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 0.800s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c69c0-663a-48c4-88bb-8c3fcb808624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb80bfdb-9830-496f-9a2e-c3dca1f9f3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:58:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Volume volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac (9359dea6-415f-4b48-a7d9-8a6f32ee14ac): created successfully
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb80bfdb-9830-496f-9a2e-c3dca1f9f3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (64ee4aa0-b9c7-460f-b202-5730c9463d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:58:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9b4940e0-67db-4d00-bbf5-b7f2bca6bb19 tempest-GroupSnapshotsTest-899590123 None] Created volume successfully.
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Creating offline snapshot 861e7779-bb35-414d-a89d-1ad949ab7e4b of volume e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1c3dc3-bbe0-4659-907b-12c94e503c18]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:51 devstack sudo[94784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65
Sep 04 05:58:51 devstack sudo[94784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] GroupSnapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: creating.
Sep 04 05:58:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Group snapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 05:58:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:52 devstack sudo[94784]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65" returned: 0 in 1.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:52 devstack sudo[94792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b 1G
Sep 04 05:58:52 devstack sudo[94792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:52 devstack sudo[94792]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b 1G" returned: 0 in 0.775s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:52 devstack sudo[94797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:58:52 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:53 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:53 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b is being set with open permissions: ugo+rw
Sep 04 05:58:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:53 devstack sudo[94802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:58:53 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:53 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:53 devstack sudo[94806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info
Sep 04 05:58:53 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:54 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:54 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info is being set with open permissions: ugo+rw
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:54 devstack sudo[94809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info
Sep 04 05:58:54 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:54 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.info" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.856s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.781s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Creating offline snapshot 9261dc8b-9f74-480d-93f7-eca8938d88da of volume 9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e4d7c-7d53-48f2-bf9b-a99233ff9fa9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0a201aee-28e0-4260-b9d5-2f1a20a2d74f tempest-VolumesDeleteCascade-1379712238 None] Create snapshot completed successfully
Sep 04 05:58:54 devstack sudo[94835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:58:54 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:55 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 1.082s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:58:55 devstack sudo[94883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da 1G
Sep 04 05:58:55 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:56 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da 1G" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:56 devstack sudo[94892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:58:56 devstack sudo[94892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:56 devstack sudo[94892]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:56 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:58:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:56 devstack sudo[94901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:58:56 devstack sudo[94901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:57 devstack sudo[94901]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:57 devstack sudo[94904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info
Sep 04 05:58:57 devstack sudo[94904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:57 devstack sudo[94904]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:57 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:58:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:57 devstack sudo[94907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info
Sep 04 05:58:57 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:58 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.info" returned: 0 in 0.314s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.353s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Creating offline snapshot 832989e1-005e-4845-8c7b-7f1dbc120ee7 of volume e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ccd840-4349-41d4-9b57-9530809ca075]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:58:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4684cf7a-2a73-4660-b99f-f08c3d3912b4 tempest-GroupSnapshotsTest-899590123 None] group_snapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: created successfully
Sep 04 05:58:58 devstack sudo[94910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:58:58 devstack sudo[94910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:58:59 devstack sudo[94910]: pam_unix(sudo:session): session closed for user root
Sep 04 05:58:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.698s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:58:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:58:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:58:59 devstack sudo[94916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 1G
Sep 04 05:58:59 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:00 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 1G" returned: 0 in 1.101s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:00 devstack sudo[94924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7
Sep 04 05:59:00 devstack sudo[94924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=83,cinder:INSERT=30,cinder:UPDATE=66,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=79,cinder:UPDATE=81,cinder:INSERT=27,cinder:DELETE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:00 devstack sudo[94924]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7" returned: 0 in 0.689s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 is being set with open permissions: ugo+rw
Sep 04 05:59:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:00 devstack sudo[94930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7
Sep 04 05:59:00 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:01 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.132s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.461s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da-a5311daf-018c-4f85-85c2-d851eca40620" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da-a5311daf-018c-4f85-85c2-d851eca40620" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Creating volume a5311daf-018c-4f85-85c2-d851eca40620 from snapshot 9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c1d463ca-0e68-42cb-a038-4b33aa52df5c tempest-VolumesDeleteCascade-1379712238 None] Create snapshot completed successfully
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] snapshot: 9261dc8b-9f74-480d-93f7-eca8938d88da, volume: a5311daf-018c-4f85-85c2-d851eca40620,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a720c4ad-8d9a-40b2-a9c8-c5f75bf3ce9b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:01 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:59:01 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:01 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf72d6d-4ffb-4f90-9c4b-f256e7ad7e9b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:02 devstack sudo[94944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:59:02 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-e7cf59ef-a35e-46da-9a44-a9a515d23e65-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-e7cf59ef-a35e-46da-9a44-a9a515d23e65-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Performing cascade delete. {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-832989e1-005e-4845-8c7b-7f1dbc120ee7-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-832989e1-005e-4845-8c7b-7f1dbc120ee7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-832989e1-005e-4845-8c7b-7f1dbc120ee7" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:02 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 0.655s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-832989e1-005e-4845-8c7b-7f1dbc120ee7" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Deleting offline snapshot 832989e1-005e-4845-8c7b-7f1dbc120ee7 of volume e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:02 devstack sudo[94950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620
Sep 04 05:59:02 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] snapshot_file for this snap is: volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cbefbb-f56d-4432-a324-5fd267b44c7d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:02 devstack sudo[94952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7
Sep 04 05:59:02 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:03 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7" returned: 0 in 0.536s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31a92d3-b307-4b82-b7a6-107d32aafe0b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:03 devstack sudo[94963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:59:03 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:04 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 1.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:04 devstack sudo[95009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7
Sep 04 05:59:04 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:05 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7" returned: 0 in 1.201s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:06 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7
Sep 04 05:59:06 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:06 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.832989e1-005e-4845-8c7b-7f1dbc120ee7" returned: 0 in 0.875s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-832989e1-005e-4845-8c7b-7f1dbc120ee7" released by "_delete_snapshot" :: held 4.383s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" released by "delete_snapshot" :: held 4.465s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:07 devstack cinder-volume[87095]: WARNING cinder.quota [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['5a60b3f0-a5dc-4748-9f8c-b65969aab8d9', '45114b8a-3552-48dd-a38e-1748dc7ac065', 'ba7de756-4b3b-441f-928d-68bff6980863', '7c51ffa5-4731-44ad-8e0a-3f1d01732c05'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Delete snapshot completed successfully.
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-832989e1-005e-4845-8c7b-7f1dbc120ee7-delete_snapshot" released by "delete_snapshot" :: held 4.999s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-861e7779-bb35-414d-a89d-1ad949ab7e4b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-861e7779-bb35-414d-a89d-1ad949ab7e4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-861e7779-bb35-414d-a89d-1ad949ab7e4b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-861e7779-bb35-414d-a89d-1ad949ab7e4b" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Deleting offline snapshot 861e7779-bb35-414d-a89d-1ad949ab7e4b of volume e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] snapshot_file for this snap is: volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebad5cc-49bb-4f15-a89e-74789fb06701]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:08 devstack sudo[95019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:59:08 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:08 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.954s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[82178beb-dcb6-449a-b644-57bab40aa68f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:08 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620" returned: 0 in 6.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 05:59:08 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Converted 1024.00 MB image at 164.06 MB/s
Sep 04 05:59:08 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:59:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:08 devstack sudo[95025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620
Sep 04 05:59:08 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:08 devstack sudo[95024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65
Sep 04 05:59:08 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:09 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620" returned: 0 in 0.247s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" released by "_copy_volume_from_snapshot" :: held 7.642s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da-a5311daf-018c-4f85-85c2-d851eca40620" released by "_create_volume_from_snapshot" :: held 7.729s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.763s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:09 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:09 devstack sudo[95032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:59:09 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7ae2a0fa-7735-4bb4-b1d1-f998e4fe81bc tempest-GroupSnapshotsTest-899590123 None] Create group from source-snapshot-79544e97-b5f4-4bea-98a5-311e2d41314c completed successfully.
Sep 04 05:59:09 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:09 devstack sudo[95038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b
Sep 04 05:59:09 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:09 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65.861e7779-bb35-414d-a89d-1ad949ab7e4b" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-861e7779-bb35-414d-a89d-1ad949ab7e4b" released by "_delete_snapshot" :: held 2.227s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" released by "delete_snapshot" :: held 2.275s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['f160252c-60c3-464d-a07c-ec2ee7893d0c', 'd08b23a0-0119-4be5-9502-047fd1b8b8aa', '8664a721-5784-49fd-9b9d-eced9ba74436', 'a81083ed-b10d-4a1e-bc35-ce4a918ff42d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Delete snapshot completed successfully.
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-861e7779-bb35-414d-a89d-1ad949ab7e4b-delete_snapshot" released by "delete_snapshot" :: held 2.556s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Snapshots deleted, issuing volume delete {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfbd33b-5c11-47d8-ba78-3211583b3779]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd6261-82a5-48bf-98f3-d7c20602705b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:10 devstack sudo[95042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65
Sep 04 05:59:10 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:10 devstack sudo[95044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620
Sep 04 05:59:10 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:10 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65" returned: 0 in 0.515s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:10 devstack sudo[95050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65
Sep 04 05:59:10 devstack sudo[95050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:10 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:10 devstack sudo[95055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620
Sep 04 05:59:10 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:11 devstack sudo[95050]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7cf59ef-a35e-46da-9a44-a9a515d23e65" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-e7cf59ef-a35e-46da-9a44-a9a515d23e65" released by "delete_volume" :: held 1.012s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:11 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a5311daf-018c-4f85-85c2-d851eca40620" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-a5311daf-018c-4f85-85c2-d851eca40620" released by "delete_volume" :: held 0.883s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['2d8fac9d-25f1-40b7-b501-9377257e7f77', 'ad32e600-f169-4fa5-a877-32f699af3158', '146900e9-f3b9-4c5c-8fc8-822351b3a0fb', '48838636-4d00-4dd5-bfca-f2ce80d0e413'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Created reservations ['8256f52b-0faa-446b-8bca-5cdfd13c4ccf'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:11 devstack sudo[95059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:11 devstack cinder-volume[87095]: WARNING cinder.quota [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1400607343 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1400607343, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:11 devstack cinder-volume[87095]: WARNING cinder.quota [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1400607343 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1400607343, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:11 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Created reservations ['92071391-993a-4aac-a625-fc51ed2b5223', '3bbae850-1352-4ab1-a54c-ce8e8224f6fd', 'a8eec105-f422-43e5-9b73-91e576af69ee', '8204f2f6-3fb5-4e82-872e-5f6b032e4444'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:11 devstack sudo[95064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:11 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:11 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Deleted volume successfully.
Sep 04 05:59:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e94efedd-7520-4343-b70a-3041410d2ca2 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-e7cf59ef-a35e-46da-9a44-a9a515d23e65-delete_volume" released by "delete_volume" :: held 9.536s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:12 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-43f22197-656f-46b9-9e39-36cd06b2d67e tempest-GroupSnapshotsTest-899590123 None] Delete group completed successfully.
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:12 devstack sudo[95081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:12 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:12 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (e396a213-502f-434d-903e-de0271939c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908e2fe9-4051-461c-8748-d6b0ee9e2544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:13 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] group_snapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: deleting
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.526s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (908e2fe9-4051-461c-8748-d6b0ee9e2544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-552250349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c27be27e6654fb385cc393f81e17424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:13Z,use_quota=True,user_id='6e1e396a83bb468ca7af6f1f2b3af3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c4f05e-1b93-418c-a641-a62f5bc6201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62c4f05e-1b93-418c-a641-a62f5bc6201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b2c212-17ac-4c95-8a78-82d1984e22d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b2c212-17ac-4c95-8a78-82d1984e22d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380', 'volume_name': 'volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fffc3f-2999-4da7-ae6c-765de4b94374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fffc3f-2999-4da7-ae6c-765de4b94374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e343980e-80b3-4445-b034-bff60d22605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Volume f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380', 'volume_size': 1}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-552250349',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c27be27e6654fb385cc393f81e17424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:13Z,use_quota=True,user_id='6e1e396a83bb468ca7af6f1f2b3af3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Creating volume f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] group_snapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 05:59:13 devstack sudo[95101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 1073741824
Sep 04 05:59:13 devstack sudo[95101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Deleting offline snapshot 9261dc8b-9f74-480d-93f7-eca8938d88da of volume 9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] snapshot_file for this snap is: volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[959ad18f-091c-468f-8792-f98334d5b6d9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:13 devstack sudo[95106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:59:13 devstack sudo[95106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:13 devstack sudo[95101]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 1073741824" returned: 0 in 0.633s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:13 devstack sudo[95106]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.478s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:13 devstack sudo[95126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:13 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51701e3-811d-4e3a-a7b9-a268d08f0a80]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:14 devstack sudo[95128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:59:14 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:14 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e343980e-80b3-4445-b034-bff60d22605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a765221-eb56-4712-b8a4-551391657b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Volume volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 (f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380): created successfully
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a765221-eb56-4712-b8a4-551391657b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (e396a213-502f-434d-903e-de0271939c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3271f2a6-4251-4b79-a71e-0c8ba552bbe2 tempest-VolumesDeleteCascade-1379712238 None] Created volume successfully.
Sep 04 05:59:14 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 0.653s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:14 devstack sudo[95136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:59:14 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:15 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:15 devstack sudo[95145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da
Sep 04 05:59:15 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Creating offline snapshot b0ae6184-0d00-4ddd-a29b-6f43a667be82 of volume f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af643429-b0c2-49fd-b697-fb3cdd9ca664]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:15 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac.9261dc8b-9f74-480d-93f7-eca8938d88da" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:15 devstack sudo[95148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:15 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9261dc8b-9f74-480d-93f7-eca8938d88da" released by "_delete_snapshot" :: held 2.136s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" released by "delete_snapshot" :: held 2.209s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:15 devstack cinder-volume[87095]: WARNING cinder.quota [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1400607343 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1400607343, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] Created reservations ['2df11e36-4191-41bf-8f42-4109c45cc659', 'e956e25b-fefd-46e2-b99d-2bf0c75654b2', '5fcf00af-c206-4b2c-a77d-75f75ce65cbb', '6c8905ff-c2c2-4d7e-9444-19de3cad31c6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-772c3bcc-2a94-4d9d-8d5b-474c9f47faab tempest-GroupSnapshotsTest-899590123 None] group_snapshot 79544e97-b5f4-4bea-98a5-311e2d41314c: deleted successfully
Sep 04 05:59:15 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.674s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:15 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 1G
Sep 04 05:59:15 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:16 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 1G" returned: 0 in 0.528s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:16 devstack sudo[95186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:16 devstack sudo[95186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:16 devstack sudo[95186]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:16 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 is being set with open permissions: ugo+rw
Sep 04 05:59:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:16 devstack sudo[95192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:16 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3f4be5-8e2d-4d28-b653-7f05d5bbe618]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:17 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:17 devstack sudo[95195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:59:17 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:17 devstack sudo[95198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info
Sep 04 05:59:17 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-d6c5debb-2d4b-4fb5-b367-2f2b45d2219b tempest-ServerActionsTestOtherA-726427569 None] Terminate volume connection completed successfully.
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-d6c5debb-2d4b-4fb5-b367-2f2b45d2219b tempest-ServerActionsTestOtherA-726427569 None] Deleting attachment 01f75ac4-97ef-4499-b5fe-e9da94819c06. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 05:59:17 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:17 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:17 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info is being set with open permissions: ugo+rw
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:17 devstack sudo[95205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac
Sep 04 05:59:17 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:17 devstack sudo[95206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info
Sep 04 05:59:17 devstack sudo[95206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "cinder-21180aca-204f-4eaa-8f67-0d54dae3799c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-21180aca-204f-4eaa-8f67-0d54dae3799c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "cinder-quobyte-21180aca-204f-4eaa-8f67-0d54dae3799c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-quobyte-21180aca-204f-4eaa-8f67-0d54dae3799c" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc4c41-3337-4d77-bc5a-cac20350de2c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:17 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:17 devstack sudo[95206]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.info" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.759s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-9359dea6-415f-4b48-a7d9-8a6f32ee14ac" released by "delete_volume" :: held 0.948s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:18 devstack sudo[95210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c
Sep 04 05:59:18 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3156d50e-e952-465a-8024-f2878b0dd3e9 tempest-VolumesDeleteCascade-1379712238 None] Create snapshot completed successfully
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['7bb7172b-0baf-432e-b070-45e13d12da6c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:18 devstack cinder-volume[87095]: WARNING cinder.db.api [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1400607343']
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['75bdf144-0c2e-4585-8e8d-6ddb19cd7f6e', '4f4bf5e7-dc54-4888-870a-ed0e48578bea', '258db37b-a4a2-4bb7-a15c-2c4ec999d475', '1b667b68-68e9-4fae-ac49-93f7183180ac'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:18 devstack sudo[95216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:18 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:18 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:18 devstack sudo[95218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c
Sep 04 05:59:18 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:18 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-35ef5446-f4b6-4f0e-9b0a-078b6dc9ea99 tempest-GroupSnapshotsTest-899590123 None] Delete group completed successfully.
Sep 04 05:59:18 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-21180aca-204f-4eaa-8f67-0d54dae3799c" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-quobyte-21180aca-204f-4eaa-8f67-0d54dae3799c" released by "delete_volume" :: held 0.881s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.quota [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Created reservations ['f551ce8e-4857-4a7f-b436-95c6e2765abd', '00af5a91-b4b0-439f-accd-2d2330ae964d', '8f23bd4a-00d5-4976-b397-307e8f63e043', 'e8bdf048-491a-4e8c-8c13-59b6cfe9383d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:18 devstack sudo[95222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:18 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (931e23dc-8027-4b65-b70e-edc526a48051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a31c16-6b8d-4148-bfc7-256437b0fc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "cinder-8532a6b3-04f0-4a37-a586-506fc052b656-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a31c16-6b8d-4148-bfc7-256437b0fc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672402714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c27be27e6654fb385cc393f81e17424',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b0ae6184-0d00-4ddd-a29b-6f43a667be82,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:19Z,use_quota=True,user_id='6e1e396a83bb468ca7af6f1f2b3af3ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725150d2-37e3-4bc0-a15a-85f8237b3fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725150d2-37e3-4bc0-a15a-85f8237b3fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:19 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84538265-39cb-4261-bcd6-773a6f35265f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84538265-39cb-4261-bcd6-773a6f35265f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa', 'volume_name': 'volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa', 'volume_size': 1, 'snapshot_id': 'b0ae6184-0d00-4ddd-a29b-6f43a667be82'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ead13-8040-43de-859e-5382e7ea2363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ead13-8040-43de-859e-5382e7ea2363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc14c71b-f59b-41c8-abed-41566aaae991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Volume 7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa', 'volume_size': 1, 'snapshot_id': 'b0ae6184-0d00-4ddd-a29b-6f43a667be82'}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.manager [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-8532a6b3-04f0-4a37-a586-506fc052b656-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Deleted volume successfully.
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Creating volume 7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa from snapshot b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-6dc56592-f8ab-4339-bb99-8f6a11512268 req-c66d34e3-d58b-46db-aa7f-a8e5e78d4fd7 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-21180aca-204f-4eaa-8f67-0d54dae3799c-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] snapshot: b0ae6184-0d00-4ddd-a29b-6f43a667be82, volume: 7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "cinder-quobyte-8532a6b3-04f0-4a37-a586-506fc052b656" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-quobyte-8532a6b3-04f0-4a37-a586-506fc052b656" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a2bac-63d2-48ad-ad5c-6db7e45e3a30]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc6c0a-d382-4da2-9b75-be45eb0cc00e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:19 devstack sudo[95225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:19 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:19 devstack sudo[95226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656
Sep 04 05:59:19 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:19 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:19 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:19 devstack sudo[95235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656
Sep 04 05:59:19 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc35f35-72a9-421c-8028-7da651ce4017]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1fe76a31-04f1-454e-b5e3-f49743fba248 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-50224666: creating
Sep 04 05:59:20 devstack sudo[95237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:20 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1fe76a31-04f1-454e-b5e3-f49743fba248 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-50224666: created successfully
Sep 04 05:59:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1fe76a31-04f1-454e-b5e3-f49743fba248 tempest-GroupSnapshotsTest-899590123 None] Create group completed successfully.
Sep 04 05:59:20 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8532a6b3-04f0-4a37-a586-506fc052b656" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-quobyte-8532a6b3-04f0-4a37-a586-506fc052b656" released by "delete_volume" :: held 0.951s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Created reservations ['cee7b71d-68c1-43a0-a879-5e0aacbc72d3', '8ea3b458-732f-4578-8bbc-7a3379daa74a', 'ba279689-0282-462c-8283-c554a7ab1deb', '933b9811-2202-44af-adac-f7f4614dbaa3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:20 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:20 devstack sudo[95244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa
Sep 04 05:59:20 devstack sudo[95244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:20 devstack sudo[95246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:20 devstack sudo[95246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:20 devstack sudo[95246]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Deleted volume successfully.
Sep 04 05:59:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6399b30e-c4d5-41a7-9e24-62db369b6c06 tempest-ServerActionsTestOtherA-726427569 None] Lock "cinder-8532a6b3-04f0-4a37-a586-506fc052b656-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (680e6a9a-59a3-4750-b6da-858e136f4301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae60678-6f76-4041-b5f3-8f380bcf579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cae60678-6f76-4041-b5f3-8f380bcf579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523300822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3441a65-1225-4537-aaef-e1deb514cae9,host='devstack@QuobyteHD#QuobyteHD',id=1ebd8ba4-9877-407d-9b8e-5363232a3c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:23Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(574aa52a-928c-4a94-a582-161c67ea6a70),volume_type_id=574aa52a-928c-4a94-a582-161c67ea6a70)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7b46f8-3e47-44ee-8fbf-de42ded7e035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7b46f8-3e47-44ee-8fbf-de42ded7e035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef98947b-2a4d-4123-b8b5-aeb60bf2aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef98947b-2a4d-4123-b8b5-aeb60bf2aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ebd8ba4-9877-407d-9b8e-5363232a3c40', 'volume_name': 'volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795be7e-38b8-4500-ad69-b271168abad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5795be7e-38b8-4500-ad69-b271168abad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90b4426-99d1-49c9-b4b1-24aaef3b28c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Volume 1ebd8ba4-9877-407d-9b8e-5363232a3c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40', 'volume_size': 1}
Sep 04 05:59:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:26 devstack sudo[95244]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" returned: 0 in 6.169s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 05:59:26 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Converted 1024.00 MB image at 165.95 MB/s
Sep 04 05:59:26 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa is being set with open permissions: ugo+rw
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:26 devstack sudo[95321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa
Sep 04 05:59:26 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:26 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" released by "_copy_volume_from_snapshot" :: held 7.588s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" released by "_create_volume_from_snapshot" :: held 7.662s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.688s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.673s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a3441a65-1225-4537-aaef-e1deb514cae9,created_at=2026-09-04T03:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1523300822',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3441a65-1225-4537-aaef-e1deb514cae9,host='devstack@QuobyteHD#QuobyteHD',id=1ebd8ba4-9877-407d-9b8e-5363232a3c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:23Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(574aa52a-928c-4a94-a582-161c67ea6a70),volume_type_id=574aa52a-928c-4a94-a582-161c67ea6a70)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Creating volume 1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:26 devstack sudo[95325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 1073741824
Sep 04 05:59:26 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc14c71b-f59b-41c8-abed-41566aaae991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa', 'volume_size': 1, 'snapshot_id': 'b0ae6184-0d00-4ddd-a29b-6f43a667be82'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158fb938-008c-4209-93b4-93069b8de5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Volume volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa (7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa): created successfully
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (158fb938-008c-4209-93b4-93069b8de5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Flow 'volume_create_manager' (931e23dc-8027-4b65-b70e-edc526a48051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-67e48664-b087-4f0d-ad78-c961a816c7d4 tempest-VolumesDeleteCascade-1379712238 None] Created volume successfully.
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 1073741824" returned: 0 in 0.530s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:27 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Performing cascade delete. {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-b0ae6184-0d00-4ddd-a29b-6f43a667be82-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:27 devstack sudo[95331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40
Sep 04 05:59:27 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-b0ae6184-0d00-4ddd-a29b-6f43a667be82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Deleting offline snapshot b0ae6184-0d00-4ddd-a29b-6f43a667be82 of volume f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] snapshot_file for this snap is: volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce14a90-8e30-44ed-a324-6180b750855d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:27 devstack sudo[95333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:27 devstack sudo[95333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:27 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90b4426-99d1-49c9-b4b1-24aaef3b28c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe7247-4cde-44b7-bf41-62cbef24418e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Volume volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 (1ebd8ba4-9877-407d-9b8e-5363232a3c40): created successfully
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50fe7247-4cde-44b7-bf41-62cbef24418e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (680e6a9a-59a3-4750-b6da-858e136f4301) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-54d56c9a-08ee-4693-9968-51f785fedace tempest-GroupSnapshotsTest-899590123 None] Created volume successfully.
Sep 04 05:59:27 devstack sudo[95333]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[614538ce-d4e3-4506-b4b8-56a94f3fdf84]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:28 devstack sudo[95339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:28 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:28 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.564s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:28 devstack sudo[95344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:28 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:28 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:29 devstack sudo[95351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82
Sep 04 05:59:29 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (8852a661-01bf-4d25-a5bf-3f90b085cf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213f8bb7-bc77-4b22-96bc-c5ecbb031176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213f8bb7-bc77-4b22-96bc-c5ecbb031176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778067302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3441a65-1225-4537-aaef-e1deb514cae9,host='devstack@QuobyteHD#QuobyteHD',id=b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:29Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(574aa52a-928c-4a94-a582-161c67ea6a70),volume_type_id=574aa52a-928c-4a94-a582-161c67ea6a70)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91657ac-9259-4e6f-a719-eb001203bce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e91657ac-9259-4e6f-a719-eb001203bce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5cd5a-538d-4630-ba3e-1d2483dd0a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5cd5a-538d-4630-ba3e-1d2483dd0a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4', 'volume_name': 'volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa593ef-2ef6-41cf-a73b-699d5a0393fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa593ef-2ef6-41cf-a73b-699d5a0393fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec72749-503c-4221-b8a9-eb80bfcfc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Volume b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4', 'volume_size': 1}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a3441a65-1225-4537-aaef-e1deb514cae9,created_at=2026-09-04T03:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-778067302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a3441a65-1225-4537-aaef-e1deb514cae9,host='devstack@QuobyteHD#QuobyteHD',id=b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:29Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(574aa52a-928c-4a94-a582-161c67ea6a70),volume_type_id=574aa52a-928c-4a94-a582-161c67ea6a70)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Creating volume b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:29 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:29 devstack sudo[95353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 1073741824
Sep 04 05:59:29 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:29 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380.b0ae6184-0d00-4ddd-a29b-6f43a667be82" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-b0ae6184-0d00-4ddd-a29b-6f43a667be82" released by "_delete_snapshot" :: held 1.789s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" released by "delete_snapshot" :: held 1.812s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['1f5e2609-29ca-45b0-9f3b-a60c6bdb34c1', '7bc79d8a-033f-4b2b-9d60-c3dad4a599b3', '0c6b3d75-ddf8-409b-b10e-fe2430da5791', '181ce75d-ea58-40c9-a3fe-95d8c2c8df03'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Delete snapshot completed successfully.
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-b0ae6184-0d00-4ddd-a29b-6f43a667be82-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Snapshots deleted, issuing volume delete {{(pid=87095) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fee7432-6dd5-4986-a025-a88672e8e7a0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:29 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 1073741824" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:29 devstack sudo[95360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:29 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:29 devstack sudo[95362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4
Sep 04 05:59:29 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:29 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:30 devstack sudo[95368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380
Sep 04 05:59:30 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:30 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec72749-503c-4221-b8a9-eb80bfcfc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da049295-6d05-40c9-b709-9f8086026a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:30 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Volume volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 (b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4): created successfully
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da049295-6d05-40c9-b709-9f8086026a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (8852a661-01bf-4d25-a5bf-3f90b085cf50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0d14176c-a66a-47e5-a632-e97ef38cd069 tempest-GroupSnapshotsTest-899590123 None] Created volume successfully.
Sep 04 05:59:30 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380" released by "delete_volume" :: held 0.782s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['fe44eaee-4733-4abf-ac83-747dda3da90e', 'b3af821c-e109-4bf9-9e25-c7d99b02beda', '2a8991b1-75ac-4a93-b6d5-c4c829814b18', 'f086c690-95bf-4ae7-a8ad-313645a0c552'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:30 devstack sudo[95372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:30 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-87749f2a-5f6d-43be-8baa-67dd6ba6b570 tempest-GroupSnapshotsTest-899590123 None] Update group completed successfully.
Sep 04 05:59:30 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Deleted volume successfully.
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ad8c44bb-27a7-4d6a-a4d3-b619feedad93 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-f9f6b8af-d4fc-4f0c-9c2f-aff4b13d0380-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" acquired by "delete_volume" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c88bd-8691-4f86-be0f-305bec26eed6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:31 devstack sudo[95375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa
Sep 04 05:59:31 devstack sudo[95375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:31 devstack sudo[95375]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:31 devstack sudo[95380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa
Sep 04 05:59:31 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8c3a5876-eb45-4615-bbb5-7ce62ac4fec9 tempest-GroupSnapshotsTest-899590123 None] Update group completed successfully.
Sep 04 05:59:31 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-quobyte-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa" released by "delete_volume" :: held 0.779s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Created reservations ['d511ee05-ea63-4e2a-848d-d649c1a207cc', '68ad912b-b406-455e-8f07-6a38c2b90584', 'c726df11-c66b-4815-a507-0332d6588d4a', '825b624f-fe2e-48ce-a382-6bb1a1abaa1d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:31 devstack sudo[95384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:31 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:32 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:32 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Deleted volume successfully.
Sep 04 05:59:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e4cc2e7-5fe6-48e8-a8c9-a2c1bfaa1b05 tempest-VolumesDeleteCascade-1379712238 None] Lock "cinder-7dcb6eb8-0707-41ff-a2cd-0c5d3a5dc0fa-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8cb097c6-f6d3-4eeb-a2eb-1bef37bdb595 tempest-GroupSnapshotsTest-899590123 None] Update group completed successfully.
Sep 04 05:59:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ebe39451-7e9e-47ab-8ad9-ffdd2d8e4b67 tempest-GroupSnapshotsTest-899590123 None] Update group completed successfully.
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (3f572e87-9b0a-450f-9046-ab21842143c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6173222a-443b-4c5c-98dd-4ab6a6a54e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] GroupSnapshot db508070-4e68-4817-a41e-8c5ab829bfd0: creating.
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6173222a-443b-4c5c-98dd-4ab6a6a54e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1338502670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314c7340-0fc2-4e68-bacc-c65a7dc96d7e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:36Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14edcca0-fecb-4c13-ab4b-3c449c390e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14edcca0-fecb-4c13-ab4b-3c449c390e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec50fd6-afa6-4837-8207-58a052118478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec50fd6-afa6-4837-8207-58a052118478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314c7340-0fc2-4e68-bacc-c65a7dc96d7e', 'volume_name': 'volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d558c601-5f70-4350-8362-4d1973dc4bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d558c601-5f70-4350-8362-4d1973dc4bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da663eac-4b89-48c0-8a4d-9a3ca6160585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Volume 314c7340-0fc2-4e68-bacc-c65a7dc96d7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e', 'volume_size': 1}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1338502670',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314c7340-0fc2-4e68-bacc-c65a7dc96d7e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:36Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Creating volume 314c7340-0fc2-4e68-bacc-c65a7dc96d7e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Group snapshot db508070-4e68-4817-a41e-8c5ab829bfd0: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 05:59:35 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e 1073741824
Sep 04 05:59:35 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:36 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e 1073741824" returned: 0 in 0.587s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (c698282f-fe5a-443b-bed6-7264e30f4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4fd79-9840-40a9-9828-798f58bf8243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71d4fd79-9840-40a9-9828-798f58bf8243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058094345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9cddfb-5c4f-440e-abef-a8df72096d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:36Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8569cffd-4cfc-4df1-a522-a94bd76c3ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8569cffd-4cfc-4df1-a522-a94bd76c3ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9c69e2-eb3b-44aa-a12d-5964409e9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9c69e2-eb3b-44aa-a12d-5964409e9a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a9cddfb-5c4f-440e-abef-a8df72096d4a', 'volume_name': 'volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af76781-83c5-48a2-a1f6-59c0b59465f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af76781-83c5-48a2-a1f6-59c0b59465f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2544dea-0bc5-4454-986f-b9b97e0b4c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Volume 6a9cddfb-5c4f-440e-abef-a8df72096d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a', 'volume_size': 1}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:36 devstack sudo[95396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e
Sep 04 05:59:36 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:36 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.929s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da663eac-4b89-48c0-8a4d-9a3ca6160585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7232471-042a-4285-9f90-777a8297c5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Creating offline snapshot 35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 of volume 1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:59:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Volume volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e (314c7340-0fc2-4e68-bacc-c65a7dc96d7e): created successfully
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7232471-042a-4285-9f90-777a8297c5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (3f572e87-9b0a-450f-9046-ab21842143c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ca9140-799b-437d-96d3-9fdb4aed03f2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5186526a-8e08-483f-b252-fa95e101d5ae tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 05:59:37 devstack sudo[95399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40
Sep 04 05:59:37 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:37 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:37 devstack sudo[95404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 1G
Sep 04 05:59:37 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:37 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 1G" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:37 devstack sudo[95410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19
Sep 04 05:59:37 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:38 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:38 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:38 devstack sudo[95415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19
Sep 04 05:59:38 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:38 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:38 devstack sudo[95418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info
Sep 04 05:59:38 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (7c860b9b-9bc4-4aa1-99f2-b245d8eed6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3a387c-445c-447a-9a00-9ff84c24a1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3a387c-445c-447a-9a00-9ff84c24a1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1669601144',display_name='tempest-VolumesGetTest-Volume-1281356094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed2828-108d-4b52-ae42-06e3af2f7fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:39Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b4920f-9570-4bdd-8a03-63b978233de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b4920f-9570-4bdd-8a03-63b978233de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3311d4-8508-437d-8b22-743cd0a5935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b3311d4-8508-437d-8b22-743cd0a5935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5ed2828-108d-4b52-ae42-06e3af2f7fb1', 'volume_name': 'volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a844df-5fd0-42a7-9310-ece6f39a28b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a844df-5fd0-42a7-9310-ece6f39a28b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c97cbfc-c790-49b0-9685-b3ad224c01f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Volume d5ed2828-108d-4b52-ae42-06e3af2f7fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1', 'volume_size': 1}
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:38 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:38 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:59:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:38 devstack sudo[95421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info
Sep 04 05:59:38 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:39 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.info" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Creating offline snapshot ea254da9-cbf4-4944-9323-17765e9cd735 of volume b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[730990bd-f299-43e7-8926-1e81ed00a098]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:39 devstack sudo[95424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4
Sep 04 05:59:39 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:39 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" returned: 0 in 0.516s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:39 devstack sudo[95430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 1G
Sep 04 05:59:39 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:40 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 1G" returned: 0 in 0.478s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:40 devstack sudo[95436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735
Sep 04 05:59:40 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:40 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735" returned: 0 in 0.313s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:40 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:40 devstack sudo[95442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735
Sep 04 05:59:40 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:40 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:40 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info
Sep 04 05:59:40 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:41 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:41 devstack sudo[95448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info
Sep 04 05:59:41 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:41 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.info" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.663s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:38Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1669601144',display_name='tempest-VolumesGetTest-Volume-1281356094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ed2828-108d-4b52-ae42-06e3af2f7fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:39Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Creating volume d5ed2828-108d-4b52-ae42-06e3af2f7fb1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:41 devstack sudo[95451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 1073741824
Sep 04 05:59:41 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-482d4438-83a2-4095-befe-1062ef5db1e0 tempest-GroupSnapshotsTest-899590123 None] group_snapshot db508070-4e68-4817-a41e-8c5ab829bfd0: created successfully
Sep 04 05:59:41 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 1073741824" returned: 0 in 0.559s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:41 devstack sudo[95456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1
Sep 04 05:59:41 devstack sudo[95456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:42 devstack sudo[95456]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] group_snapshot db508070-4e68-4817-a41e-8c5ab829bfd0: deleting
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.724s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1058094345',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a9cddfb-5c4f-440e-abef-a8df72096d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:36Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Creating volume 6a9cddfb-5c4f-440e-abef-a8df72096d4a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c97cbfc-c790-49b0-9685-b3ad224c01f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c113f1-9e0d-42e8-a96c-e689ad9e1879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:42 devstack sudo[95459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a 1073741824
Sep 04 05:59:42 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] group_snapshot db508070-4e68-4817-a41e-8c5ab829bfd0: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 05:59:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Volume volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 (d5ed2828-108d-4b52-ae42-06e3af2f7fb1): created successfully
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c113f1-9e0d-42e8-a96c-e689ad9e1879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (7c860b9b-9bc4-4aa1-99f2-b245d8eed6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-248da22b-99c8-45c6-a55e-a11bc38b5b1d tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Deleting offline snapshot 35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 of volume 1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] snapshot_file for this snap is: volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2435e30-13a9-49fd-bde0-ee48f33bd413]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:42 devstack sudo[95461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19
Sep 04 05:59:42 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-d5ed2828-108d-4b52-ae42-06e3af2f7fb1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:43 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a 1073741824" returned: 0 in 0.724s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "cinder-d5ed2828-108d-4b52-ae42-06e3af2f7fb1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:43 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:43 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a
Sep 04 05:59:43 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e1b04f-e0d6-42b5-ad3d-29a7067b9c48]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1099ac4c-135e-49cd-8c89-d8c98a3f59eb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:43 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40
Sep 04 05:59:43 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack sudo[95474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1
Sep 04 05:59:43 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2544dea-0bc5-4454-986f-b9b97e0b4c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5155f934-6dd7-4e0d-a5ba-c955b91608a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Volume volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a (6a9cddfb-5c4f-440e-abef-a8df72096d4a): created successfully
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5155f934-6dd7-4e0d-a5ba-c955b91608a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (c698282f-fe5a-443b-bed6-7264e30f4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-993f6c86-31c4-4875-b882-17fbf3a0d9ed tempest-AttachVolumeNegativeTest-522443171 None] Created volume successfully.
Sep 04 05:59:43 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:43 devstack sudo[95481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19
Sep 04 05:59:43 devstack sudo[95481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:43 devstack sudo[95486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1
Sep 04 05:59:43 devstack sudo[95486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:43 devstack sudo[95481]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:44 devstack sudo[95486]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:44 devstack sudo[95493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-d5ed2828-108d-4b52-ae42-06e3af2f7fb1" released by "delete_volume" :: held 0.849s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:44 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Created reservations ['9e08fc36-4098-4896-8721-c0f61eb16a59', 'c1cac2f6-c034-4d7e-822b-494bf0c77eb6', 'f0cd15e0-a298-4de7-b9e4-746792982625', '207f4d59-4ae6-4458-9031-1cd2667b278a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:44 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:44 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:44 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40.35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" returned: 0 in 0.330s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-35adc292-fb2c-40ec-8a38-d4d5bbc0fd19" released by "_delete_snapshot" :: held 1.923s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" released by "delete_snapshot" :: held 1.961s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-ea254da9-cbf4-4944-9323-17765e9cd735" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-ea254da9-cbf4-4944-9323-17765e9cd735" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Deleting offline snapshot ea254da9-cbf4-4944-9323-17765e9cd735 of volume b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] snapshot_file for this snap is: volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebca27e9-1452-462d-a00f-0c21155a331d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:44 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 05:59:44 devstack sudo[95502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735
Sep 04 05:59:44 devstack sudo[95502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-62a2188c-be4b-4248-a097-f98888dcb959 tempest-VolumesGetTest-948025850 None] Lock "cinder-d5ed2828-108d-4b52-ae42-06e3af2f7fb1-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:45 devstack sudo[95502]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7e10fd-210a-4ac1-9e48-56a84e93913c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:45 devstack sudo[95513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4
Sep 04 05:59:45 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5d9ec4b9-04c3-4fc7-a1d6-a1baae0d9eab req-62305c0a-2d27-4b77-8c61-713f7f81711e tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5d9ec4b9-04c3-4fc7-a1d6-a1baae0d9eab req-62305c0a-2d27-4b77-8c61-713f7f81711e tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5d9ec4b9-04c3-4fc7-a1d6-a1baae0d9eab req-62305c0a-2d27-4b77-8c61-713f7f81711e tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-5d9ec4b9-04c3-4fc7-a1d6-a1baae0d9eab req-62305c0a-2d27-4b77-8c61-713f7f81711e tempest-AttachVolumeNegativeTest-522443171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3056494-72a3-4730-9b52-840744999255', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-314c7340-0fc2-4e68-bacc-c65a7dc96d7e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-5d9ec4b9-04c3-4fc7-a1d6-a1baae0d9eab req-62305c0a-2d27-4b77-8c61-713f7f81711e tempest-AttachVolumeNegativeTest-522443171 None] attachment_update completed successfully.
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "cinder-314c7340-0fc2-4e68-bacc-c65a7dc96d7e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:45 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" returned: 0 in 0.482s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:45 devstack sudo[95523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735
Sep 04 05:59:45 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3707b2a7-3cbc-4d7f-929a-d057f5e89c60]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:45 devstack sudo[95546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e
Sep 04 05:59:45 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:45 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:46 devstack sudo[95916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735
Sep 04 05:59:46 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:46 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" returned: 0 in 0.617s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:46 devstack sudo[95924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e
Sep 04 05:59:46 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:46 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4.ea254da9-cbf4-4944-9323-17765e9cd735" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-ea254da9-cbf4-4944-9323-17765e9cd735" released by "_delete_snapshot" :: held 1.946s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" released by "delete_snapshot" :: held 1.979s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:46 devstack cinder-volume[87095]: WARNING cinder.quota [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-318974492 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-318974492, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:46 devstack cinder-volume[87095]: WARNING cinder.quota [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-318974492 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-318974492, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Created reservations ['57b6a288-189a-47e0-9cf5-2bfc657ad2e6', '67117b6d-8fcb-4f06-80ae-906e65bd10af', '9bac49f3-6a80-4ebf-9fbd-e845ec530a2d', '18284e63-08df-45ab-bb55-2c3440f88606'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:46 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" returned: 0 in 0.322s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-314c7340-0fc2-4e68-bacc-c65a7dc96d7e" released by "delete_volume" :: held 1.004s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Created reservations ['b55c7e69-dc03-4607-9e40-56a4207712b6', 'f1180761-1f5c-4105-bcad-e914b990d403', 'b70f5c7d-976a-42a7-a1bd-c0e51616f555', 'fd801e0e-4844-40f8-b945-d8d98630b415'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] Created reservations ['55abd7be-cbde-4f40-a437-961157a03a8c', '531f87f0-7750-40b1-9775-89b30070de06', 'ff4a7b00-b989-43d7-bc8d-9f3278c1e9e7', 'a7f95cdc-e3e8-4740-9494-d36556ca325f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:46 devstack sudo[95931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:46 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-107a037f-7714-4184-86ec-56fbb9e0ecaf tempest-GroupSnapshotsTest-899590123 None] group_snapshot db508070-4e68-4817-a41e-8c5ab829bfd0: deleted successfully
Sep 04 05:59:47 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6e9a5a08-15fd-4aa2-9fa9-6cc723645ba2 tempest-VolumesGetTest-948025850 None] Lock "cinder-314c7340-0fc2-4e68-bacc-c65a7dc96d7e-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2acb3f4-290b-444f-afb3-690cfb402117]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:47 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40
Sep 04 05:59:47 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:48 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40" returned: 0 in 0.574s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:48 devstack sudo[95939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40
Sep 04 05:59:48 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:48 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (e3d0ba34-6f43-4902-9d49-37d5c2388305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a240ebac-08aa-4962-9aef-1a243ff685a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1ebd8ba4-9877-407d-9b8e-5363232a3c40" returned: 0 in 0.363s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a240ebac-08aa-4962-9aef-1a243ff685a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1548652327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:48Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0971bf04-f27e-43fc-a093-978c9b6ea393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0971bf04-f27e-43fc-a093-978c9b6ea393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9aad3-3db3-4267-bca1-9072836e9616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece9aad3-3db3-4267-bca1-9072836e9616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'volume_name': 'volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4885d09-6836-425f-b715-f7b95fff1b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4885d09-6836-425f-b715-f7b95fff1b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e51cd24-ef16-4b7b-89ab-5942c55364ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Volume cfc61fbc-dc91-4ea5-a755-f85ed53b86cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'volume_size': 1}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1548652327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:48Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Creating volume cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 05:59:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-1ebd8ba4-9877-407d-9b8e-5363232a3c40" released by "delete_volume" :: held 1.101s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:48 devstack sudo[95942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf 1073741824
Sep 04 05:59:48 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd020056-43a2-42be-8027-2f7babf936ae]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:48 devstack sudo[95944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4
Sep 04 05:59:48 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:49 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" returned: 0 in 0.489s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:49 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4
Sep 04 05:59:49 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:49 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf 1073741824" returned: 0 in 0.723s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:49 devstack sudo[95955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 05:59:49 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:49 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-b754f4c9-b3b9-4ef3-a7df-f20bbb233ef4" released by "delete_volume" :: held 0.907s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['9b2aaac7-442b-44d6-b050-0f993beeef99'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:49 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:49 devstack cinder-volume[87095]: WARNING cinder.quota [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-318974492 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-318974492, it is now deprecated. Please use the default quota class for default quota.
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e51cd24-ef16-4b7b-89ab-5942c55364ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d9452b-8e58-4e8d-bbeb-bca0b4767759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['7e81c008-612d-4be5-8c43-f900f7e4bba8', 'd4adf4a1-8931-4fa7-88b3-bee7f6886d1f', 'b03ff6a1-4ece-4e72-aa59-abed0c6ecf45', '40768f56-5e4b-40b8-ae5c-fa176d8953d8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Volume volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf (cfc61fbc-dc91-4ea5-a755-f85ed53b86cf): created successfully
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48d9452b-8e58-4e8d-bbeb-bca0b4767759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (e3d0ba34-6f43-4902-9d49-37d5c2388305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3628134a-91a6-48e1-9e17-4ca2253dc50b tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 05:59:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['1269be6a-3e0d-486e-936d-dda10909366c', '3de37d4a-1c34-4a11-80f2-41775c9aa4e8', '372514b7-72c8-4f84-92bf-d186d290a6fe', 'ae673c6a-4dbb-44c4-9840-bf3610ec7e1d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:50 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 05:59:50 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:50 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 05:59:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e2f4b5c9-9405-4970-8edd-415eb0f4d472 tempest-GroupSnapshotsTest-899590123 None] Delete group completed successfully.
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (3d3ba981-41c0-4d6b-bb81-f25e0798ae15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac4b15-a026-4e8d-a6ba-1063e27a4319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ac4b15-a026-4e8d-a6ba-1063e27a4319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1784438779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=765456a1-106c-4022-8b4f-0c12b2357af6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:51Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38dbba7-5eb7-4bf3-af3c-52c4d0e16af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f38dbba7-5eb7-4bf3-af3c-52c4d0e16af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1ac73-507d-44d1-b636-1fd3fd08ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c1ac73-507d-44d1-b636-1fd3fd08ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '765456a1-106c-4022-8b4f-0c12b2357af6', 'volume_name': 'volume-765456a1-106c-4022-8b4f-0c12b2357af6', 'volume_size': 1, 'source_volid': 'cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9873c4-6091-4b0d-9a44-0bfdc3ef14c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9873c4-6091-4b0d-9a44-0bfdc3ef14c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eb5d6f-7d17-42c7-81eb-373be186c66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Volume 765456a1-106c-4022-8b4f-0c12b2357af6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-765456a1-106c-4022-8b4f-0c12b2357af6', 'volume_size': 1, 'source_volid': 'cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'source_volstatus': 'available'}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Cloning volume cfc61fbc-dc91-4ea5-a755-f85ed53b86cf to volume 765456a1-106c-4022-8b4f-0c12b2357af6
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Creating offline snapshot c4699df3-e654-432e-9aa4-2250bb906ddc of volume cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f8a0b-e88c-4082-8bad-4bfc9d751f95]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:51 devstack sudo[95970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 05:59:51 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5defa4b0-c989-4eca-a9d6-1af54a08bbc1 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-1721594587: creating
Sep 04 05:59:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5defa4b0-c989-4eca-a9d6-1af54a08bbc1 tempest-GroupSnapshotsTest-899590123 None] Group tempest-GroupSnapshotsTest-Group-1721594587: created successfully
Sep 04 05:59:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5defa4b0-c989-4eca-a9d6-1af54a08bbc1 tempest-GroupSnapshotsTest-899590123 None] Create group completed successfully.
Sep 04 05:59:52 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 0.657s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:52 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc 1G
Sep 04 05:59:52 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:53 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc 1G" returned: 0 in 0.793s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:53 devstack sudo[95997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 05:59:53 devstack sudo[95997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:53 devstack sudo[95997]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 0.461s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:53 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc is being set with open permissions: ugo+rw
Sep 04 05:59:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:53 devstack sudo[96008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 05:59:53 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:54 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 0.716s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:54 devstack sudo[96015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info
Sep 04 05:59:54 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (e6f3d1a6-f665-4e1a-9c29-41c79a56feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c438b0eb-8f3e-4590-86d0-617294eddf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c438b0eb-8f3e-4590-86d0-617294eddf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449104334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=56838c86-9247-4716-a1ab-53015422d089,host='devstack@QuobyteHD#QuobyteHD',id=20a918d9-6e37-490f-a9b3-c40c289438b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:55Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c32ec5dd-fb79-4675-b410-7b5287def670),volume_type_id=c32ec5dd-fb79-4675-b410-7b5287def670)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c431b5c9-4dd6-4085-a272-69e4f174c3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c431b5c9-4dd6-4085-a272-69e4f174c3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a658b6-add5-4dae-aea0-543d385bb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8a658b6-add5-4dae-aea0-543d385bb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20a918d9-6e37-490f-a9b3-c40c289438b2', 'volume_name': 'volume-20a918d9-6e37-490f-a9b3-c40c289438b2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f43bf26-9246-4363-9b39-d0072160b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f43bf26-9246-4363-9b39-d0072160b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adcd13c-c496-43a5-9a55-f20b8c78e7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 05:59:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Volume 20a918d9-6e37-490f-a9b3-c40c289438b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20a918d9-6e37-490f-a9b3-c40c289438b2', 'volume_size': 1}
Sep 04 05:59:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:55 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info" returned: 0 in 0.666s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:55 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info is being set with open permissions: ugo+rw
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:55 devstack sudo[96027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info
Sep 04 05:59:55 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:55 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.info" returned: 0 in 0.521s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] snapshot: c4699df3-e654-432e-9aa4-2250bb906ddc, volume: 765456a1-106c-4022-8b4f-0c12b2357af6,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49740b-a30a-4a2c-96fc-5408d7ae9dfe]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:55 devstack sudo[96037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 05:59:55 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:56 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4961f5b-9e1a-4dd7-9451-374e831ac7f7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:56 devstack sudo[96053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 05:59:56 devstack sudo[96053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 05:59:56 devstack sudo[96053]: pam_unix(sudo:session): session closed for user root
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 05:59:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 05:59:56 devstack sudo[96061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6
Sep 04 05:59:56 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=163,cinder:DELETE=12,cinder:UPDATE=184,cinder:INSERT=40 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:00:04 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=155,cinder:UPDATE=160,cinder:INSERT=45,cinder:DELETE=5 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:00:06 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6" returned: 0 in 9.686s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:06 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:00:06 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Converted 1024.00 MB image at 105.71 MB/s
Sep 04 06:00:06 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 is being set with open permissions: ugo+rw
Sep 04 06:00:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:06 devstack sudo[96217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6
Sep 04 06:00:06 devstack sudo[96217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:07 devstack sudo[96217]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6" returned: 0 in 0.621s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" released by "_copy_volume_from_snapshot" :: held 11.431s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-c4699df3-e654-432e-9aa4-2250bb906ddc" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-c4699df3-e654-432e-9aa4-2250bb906ddc" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Deleting offline snapshot c4699df3-e654-432e-9aa4-2250bb906ddc of volume cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] snapshot_file for this snap is: volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca9185e-e226-4157-a69b-da396bca07d3]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:07 devstack sudo[96221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 06:00:07 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:08 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 0.914s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:00:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e75554-0ded-423a-888c-241f8877fd6d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:08 devstack sudo[96264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 06:00:08 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:09 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 1.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:09 devstack sudo[96275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 06:00:09 devstack sudo[96275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:10 devstack sudo[96275]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 1.065s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:10 devstack sudo[96283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc
Sep 04 06:00:10 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:11 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf.c4699df3-e654-432e-9aa4-2250bb906ddc" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-c4699df3-e654-432e-9aa4-2250bb906ddc" released by "_delete_snapshot" :: held 4.153s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.800s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.389s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=56838c86-9247-4716-a1ab-53015422d089,created_at=2026-09-04T03:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449104334',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=56838c86-9247-4716-a1ab-53015422d089,host='devstack@QuobyteHD#QuobyteHD',id=20a918d9-6e37-490f-a9b3-c40c289438b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad6c8604db34895a12bac69a9c2226b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T03:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T03:59:55Z,use_quota=True,user_id='46bafb490f404e018e81f700759830ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c32ec5dd-fb79-4675-b410-7b5287def670),volume_type_id=c32ec5dd-fb79-4675-b410-7b5287def670)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Creating volume 20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:11 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20eb5d6f-7d17-42c7-81eb-373be186c66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-765456a1-106c-4022-8b4f-0c12b2357af6', 'volume_size': 1, 'source_volid': 'cfc61fbc-dc91-4ea5-a755-f85ed53b86cf', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0670f86-7c61-4df3-826c-84596e436ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:11 devstack sudo[96287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 1073741824
Sep 04 06:00:11 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Volume volume-765456a1-106c-4022-8b4f-0c12b2357af6 (765456a1-106c-4022-8b4f-0c12b2357af6): created successfully
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0670f86-7c61-4df3-826c-84596e436ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (3d3ba981-41c0-4d6b-bb81-f25e0798ae15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-590b70f1-bcdd-4a1b-91b0-be6772fecbf6 tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 06:00:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:00:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:00:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:00:12 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 1073741824" returned: 0 in 1.192s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:12 devstack sudo[96307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2
Sep 04 06:00:12 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:13 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2" returned: 0 in 0.956s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adcd13c-c496-43a5-9a55-f20b8c78e7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20a918d9-6e37-490f-a9b3-c40c289438b2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7202d16-9c9d-474a-b7b3-348e5712f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Volume volume-20a918d9-6e37-490f-a9b3-c40c289438b2 (20a918d9-6e37-490f-a9b3-c40c289438b2): created successfully
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7202d16-9c9d-474a-b7b3-348e5712f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Flow 'volume_create_manager' (e6f3d1a6-f665-4e1a-9c29-41c79a56feeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7ad3ceeb-aac7-4f71-8641-044765e0aaad tempest-GroupSnapshotsTest-899590123 None] Created volume successfully.
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (eca0b9a6-dec5-4608-a9eb-ece1960226a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c35e531-c33d-4e82-aae0-5662a26c323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c35e531-c33d-4e82-aae0-5662a26c323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-127497863',display_name='tempest-VolumesGetTest-Volume-1804528196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed14032-06a4-4c90-963f-fb9c77d698e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:14Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418b0caf-6f08-490c-95af-66060231414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418b0caf-6f08-490c-95af-66060231414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d86cb97-8f6c-4be0-bfeb-13a4ea1b5495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d86cb97-8f6c-4be0-bfeb-13a4ea1b5495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed14032-06a4-4c90-963f-fb9c77d698e9', 'volume_name': 'volume-7ed14032-06a4-4c90-963f-fb9c77d698e9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cbb27d-fb19-432a-9830-f50af2dfda92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4cbb27d-fb19-432a-9830-f50af2dfda92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12dab12-4149-4600-a5bf-a115d4c9bf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Volume 7ed14032-06a4-4c90-963f-fb9c77d698e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed14032-06a4-4c90-963f-fb9c77d698e9', 'volume_size': 1}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:13Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-127497863',display_name='tempest-VolumesGetTest-Volume-1804528196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed14032-06a4-4c90-963f-fb9c77d698e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:14Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Creating volume 7ed14032-06a4-4c90-963f-fb9c77d698e9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:14 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:14 devstack sudo[96348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 1073741824
Sep 04 06:00:14 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:16 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 1073741824" returned: 0 in 1.498s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] GroupSnapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: creating.
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Group snapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 06:00:16 devstack sudo[96374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9
Sep 04 06:00:16 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:16 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9" returned: 0 in 0.601s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.238s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.529s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Creating offline snapshot 8db49c70-7172-42d4-b15d-56c4c3684994 of volume 20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12dab12-4149-4600-a5bf-a115d4c9bf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed14032-06a4-4c90-963f-fb9c77d698e9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c946ff0b-818c-4597-bac7-49524ce27d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1abaad7-ca16-4f00-a9b9-e921680b4f4a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Volume volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 (7ed14032-06a4-4c90-963f-fb9c77d698e9): created successfully
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c946ff0b-818c-4597-bac7-49524ce27d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (eca0b9a6-dec5-4608-a9eb-ece1960226a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dab66d0a-173e-4fe5-9042-d235638e0881 tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 06:00:17 devstack sudo[96380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2
Sep 04 06:00:17 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:17 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2" returned: 0 in 0.895s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:17 devstack sudo[96385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 1G
Sep 04 06:00:17 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-7ed14032-06a4-4c90-963f-fb9c77d698e9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "cinder-7ed14032-06a4-4c90-963f-fb9c77d698e9-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-7ed14032-06a4-4c90-963f-fb9c77d698e9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-7ed14032-06a4-4c90-963f-fb9c77d698e9" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f95561b-45de-4a76-a591-aca000bd2121]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:18 devstack sudo[96387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9
Sep 04 06:00:18 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:18 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 1G" returned: 0 in 1.014s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a918d9-6e37-490f-a9b3-c40c289438b2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:18 devstack sudo[96393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a918d9-6e37-490f-a9b3-c40c289438b2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994
Sep 04 06:00:18 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:18 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9" returned: 0 in 0.767s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:19 devstack sudo[96398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9
Sep 04 06:00:19 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Flow 'volume_create_manager' (a8f02cd3-e36f-462d-9cbd-76e1afd01897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1534ab78-e248-4608-82ef-cdde2f72f974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1534ab78-e248-4608-82ef-cdde2f72f974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-990436051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b004d9-3e33-4d06-af8c-9894e0410d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4af4af9a74db69d7b3ed46db19c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:19Z,use_quota=True,user_id='14c747005bc745b4970b25409bf55176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c95a02a-957d-4bc9-b6c4-4bba7a197174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c95a02a-957d-4bc9-b6c4-4bba7a197174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74201b2-cb6b-47ba-a97c-25d90e98fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74201b2-cb6b-47ba-a97c-25d90e98fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b004d9-3e33-4d06-af8c-9894e0410d94', 'volume_name': 'volume-49b004d9-3e33-4d06-af8c-9894e0410d94', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa48d986-e26e-4dab-9b72-b80f3ce0245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa48d986-e26e-4dab-9b72-b80f3ce0245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1e6947-e745-4c4c-af41-c0dd9980c37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Volume 49b004d9-3e33-4d06-af8c-9894e0410d94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b004d9-3e33-4d06-af8c-9894e0410d94', 'volume_size': 1}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:19 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20a918d9-6e37-490f-a9b3-c40c289438b2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994" returned: 0 in 0.572s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:19 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:19 devstack sudo[96403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994
Sep 04 06:00:19 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:19 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ed14032-06a4-4c90-963f-fb9c77d698e9" returned: 0 in 0.510s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-7ed14032-06a4-4c90-963f-fb9c77d698e9" released by "delete_volume" :: held 1.363s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Created reservations ['efe20b2f-7243-43d8-9666-081f17ed75e1', '9f4539de-1db6-4a45-ae14-b671083c1d19', 'c1b8b594-7c11-472c-8bd4-80313500a28f', 'df714fd5-6f3f-4310-8a51-0c824666905b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:19 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:19 devstack sudo[96446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:19 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:19 devstack sudo[96447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info
Sep 04 06:00:19 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:20 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 06:00:20 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:20 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6c49cd15-e0fa-4c4e-84ce-892e0a687cb0 tempest-VolumesGetTest-948025850 None] Lock "cinder-7ed14032-06a4-4c90-963f-fb9c77d698e9-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:20 devstack sudo[96452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info
Sep 04 06:00:20 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:20 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.info" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.871s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.373s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-990436051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b004d9-3e33-4d06-af8c-9894e0410d94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9df4af4af9a74db69d7b3ed46db19c05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:19Z,use_quota=True,user_id='14c747005bc745b4970b25409bf55176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Creating volume 49b004d9-3e33-4d06-af8c-9894e0410d94 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-765456a1-106c-4022-8b4f-0c12b2357af6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "cinder-765456a1-106c-4022-8b4f-0c12b2357af6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:20 devstack sudo[96456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 1073741824
Sep 04 06:00:20 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46e53fc9-e457-4696-8663-e1012e5185a7 tempest-GroupSnapshotsTest-899590123 None] group_snapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: created successfully
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68c1117-e33b-40f4-94fb-934c41ab6753]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:21 devstack sudo[96458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6
Sep 04 06:00:21 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:21 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:21 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 1073741824" returned: 0 in 0.709s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:21 devstack sudo[96467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6
Sep 04 06:00:21 devstack sudo[96467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:21 devstack sudo[96469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94
Sep 04 06:00:21 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:21 devstack sudo[96467]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-765456a1-106c-4022-8b4f-0c12b2357af6" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-765456a1-106c-4022-8b4f-0c12b2357af6" released by "delete_volume" :: held 0.959s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:21 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94" returned: 0 in 0.492s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] group_snapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: deleting
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Created reservations ['9def1d93-78c1-4c22-8543-b15c5252c675', '56083e7b-f82f-4040-9f43-a649fb975457', '86cc7e94-6c91-41b1-8681-9ac0bd111569', '76196d21-155b-4649-92be-09adf5ca9524'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d1e6947-e745-4c4c-af41-c0dd9980c37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b004d9-3e33-4d06-af8c-9894e0410d94', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dc83e7-7ecb-404e-9262-d0f410b4f25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Volume volume-49b004d9-3e33-4d06-af8c-9894e0410d94 (49b004d9-3e33-4d06-af8c-9894e0410d94): created successfully
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12dc83e7-7ecb-404e-9262-d0f410b4f25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Flow 'volume_create_manager' (a8f02cd3-e36f-462d-9cbd-76e1afd01897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c11a7283-b37d-4d0f-a030-dbfe1e861fe6 tempest-ServerRescueNegativeTestJSON-481070022 None] Created volume successfully.
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] group_snapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-8db49c70-7172-42d4-b15d-56c4c3684994" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-8db49c70-7172-42d4-b15d-56c4c3684994" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:22 devstack sudo[96474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:22 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Deleting offline snapshot 8db49c70-7172-42d4-b15d-56c4c3684994 of volume 20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] snapshot_file for this snap is: volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1250f21-3c91-4991-b4da-10ca9965c6f9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:22 devstack sudo[96476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994
Sep 04 06:00:22 devstack sudo[96476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:22 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-549af50e-6692-49fc-a894-f2c07d14064c tempest-VolumesGetTest-948025850 None] Lock "cinder-765456a1-106c-4022-8b4f-0c12b2357af6-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:22 devstack sudo[96476]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20a918d9-6e37-490f-a9b3-c40c289438b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f18208d-83ea-4d03-8578-8e5c7f7a73ec]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "cinder-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:23 devstack sudo[96482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2
Sep 04 06:00:23 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" acquired by "delete_volume" :: waited 0.050s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[954199d0-8695-4cef-8ab2-fd35e0a7519f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:23 devstack sudo[96484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 06:00:23 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:23 devstack sudo[96484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2" returned: 0 in 0.620s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:23 devstack sudo[96505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994
Sep 04 06:00:23 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:24 devstack sudo[96484]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 0.832s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:24 devstack sudo[96513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf
Sep 04 06:00:24 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:24 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994" returned: 0 in 0.697s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:24 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994
Sep 04 06:00:24 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:24 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf" released by "delete_volume" :: held 1.406s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:24 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2.8db49c70-7172-42d4-b15d-56c4c3684994" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Created reservations ['250539f0-b9a9-42d6-a030-f3f4040445ec', '1f094288-1b8f-4f42-b722-89176010d6bd', '4efe3965-ca48-4dc6-a920-b385687ff31c', 'f6c8d38f-fe1a-4117-810d-827f3dd491ac'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-8db49c70-7172-42d4-b15d-56c4c3684994" released by "_delete_snapshot" :: held 2.491s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" released by "delete_snapshot" :: held 2.565s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:25 devstack cinder-volume[87095]: WARNING cinder.quota [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-287153511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-287153511, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:25 devstack cinder-volume[87095]: WARNING cinder.quota [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-287153511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-287153511, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:25 devstack sudo[96520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:25 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] Created reservations ['d2fc3c6b-8b6f-471f-aa43-283bf31279c2', 'ce915e18-d56d-4a6d-a980-21e0c2a49ecc', '2dffd708-a80a-4f6c-8400-31d03a4e80c7', '439383af-b030-47ff-93f7-797fa5b7c393'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fd2cb023-0be8-4c52-9320-f42ca93bde7b tempest-GroupSnapshotsTest-899590123 None] group_snapshot 4a9dab98-7912-425a-ba12-0395e12a19eb: deleted successfully
Sep 04 06:00:25 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 06:00:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-acaf337d-15af-4726-a8a9-7052d169fe72 tempest-VolumesGetTest-948025850 None] Lock "cinder-cfc61fbc-dc91-4ea5-a755-f85ed53b86cf-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed2810b-a2f6-453a-82b8-d51ad35c2808]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:26 devstack sudo[96545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2
Sep 04 06:00:26 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:27 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (a5c347aa-7c9b-42ee-b6f6-43dd0a9f5433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5832c903-3aaa-4a38-8cb1-886027194106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2" returned: 0 in 0.832s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5832c903-3aaa-4a38-8cb1-886027194106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1256658054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1730ce37-ea54-4418-b753-debf8fee3f58,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:27Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4be55a-f612-44c6-95a0-b2a45ccfe298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da4be55a-f612-44c6-95a0-b2a45ccfe298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e564ab33-1061-48fb-9c44-91b3469f08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:00:27 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2
Sep 04 06:00:27 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:27 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-20a918d9-6e37-490f-a9b3-c40c289438b2" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Lock "cinder-quobyte-20a918d9-6e37-490f-a9b3-c40c289438b2" released by "delete_volume" :: held 1.494s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:27 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['a9958bc7-6e8c-4d14-b15e-322b0458efad'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:27 devstack cinder-volume[87095]: WARNING cinder.quota [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-287153511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-287153511, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Created reservations ['23472cdd-7a82-4e95-b3a0-870327263cb6', '0b2ed806-6950-45c4-8ca4-925513a65998', '562dee07-4472-4c50-9b80-daa82e41588d', '9406e835-c225-44a4-8094-ed5f7dddd4e0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e564ab33-1061-48fb-9c44-91b3469f08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1730ce37-ea54-4418-b753-debf8fee3f58', 'volume_name': 'volume-1730ce37-ea54-4418-b753-debf8fee3f58', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e76f680>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a68079-fb6e-439a-b8b6-55d6da4f8b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a68079-fb6e-439a-b8b6-55d6da4f8b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded50eca-141d-4956-8330-ec0d8b521fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Volume 1730ce37-ea54-4418-b753-debf8fee3f58: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1730ce37-ea54-4418-b753-debf8fee3f58', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e76f680>}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Trying to clone 1730ce37-ea54-4418-b753-debf8fee3f58 from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:28 devstack sudo[96627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:28 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:00:28 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 06:00:28 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-421f03cc-8c0a-457b-8ab6-d334d8cbf9f0 tempest-GroupSnapshotsTest-899590123 None] Delete group completed successfully.
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce72125-5def-4127-b343-6cfe718b5e44]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:28 devstack sudo[96632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD
Sep 04 06:00:28 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:29 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 is fetched for user 5750f70a5a7d421eb1e0227bcf50556a. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a96f3ce-3e66-46ee-bf60-d3e47d320db1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:29 devstack sudo[96638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD
Sep 04 06:00:29 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:29 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD" returned: 0 in 0.582s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1256658054',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1730ce37-ea54-4418-b753-debf8fee3f58,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:27Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Creating volume 1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:30 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:30 devstack sudo[96644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1073741824
Sep 04 06:00:30 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:30 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1073741824" returned: 0 in 0.808s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:30 devstack sudo[96657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58
Sep 04 06:00:30 devstack sudo[96657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:31 devstack sudo[96657]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] <== create_volume: return (1370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Attempting download of c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 1730ce37-ea54-4418-b753-debf8fee3f58. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[698797d4-6f35-4385-9586-1ebde5242774]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:31 devstack sudo[96681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci
Sep 04 06:00:31 devstack sudo[96681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:31 devstack sudo[96681]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:32 devstack sudo[96686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci
Sep 04 06:00:32 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:32 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci" returned: 1 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_z43m0xci' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:00:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4c3c5b-4d5f-4efd-9f42-fdcf5e5b9e05]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:32 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD
Sep 04 06:00:32 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:33 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD" returned: 0 in 0.699s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:33 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] c1c4afc1-734f-46ce-9589-8a0fba4d2421 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:00:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:33 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58
Sep 04 06:00:33 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Acquiring lock "cinder-49b004d9-3e33-4d06-af8c-9894e0410d94-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "cinder-49b004d9-3e33-4d06-af8c-9894e0410d94-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Acquiring lock "cinder-quobyte-49b004d9-3e33-4d06-af8c-9894e0410d94" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "cinder-quobyte-49b004d9-3e33-4d06-af8c-9894e0410d94" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32f1646-34c3-46b1-9379-f6d74f01f72b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:34 devstack sudo[96727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94
Sep 04 06:00:34 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:35 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94" returned: 0 in 0.609s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:35 devstack sudo[96732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94
Sep 04 06:00:35 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:35 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-49b004d9-3e33-4d06-af8c-9894e0410d94" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "cinder-quobyte-49b004d9-3e33-4d06-af8c-9894e0410d94" released by "delete_volume" :: held 1.069s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:35 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58" returned: 0 in 2.626s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421__260rt09devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:00:35 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Converted 112.00 MB image at 42.64 MB/s
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:35 devstack sudo[96735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1G
Sep 04 06:00:35 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Created reservations ['3a475ddf-f3f0-42ef-855c-6ee0801abcf2', '7ae76c7f-d705-452f-98f9-59599679111d', 'f0eb1b86-4e57-4a20-a305-8e1b595d46f9', 'd1a9ce46-4083-41e6-a9da-4f3aca56c4e3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:36 devstack sudo[96739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:36 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:36 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 1G" returned: 0 in 0.519s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Downloaded image c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 1730ce37-ea54-4418-b753-debf8fee3f58 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 for user 5750f70a5a7d421eb1e0227bcf50556a is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Marking volume 1730ce37-ea54-4418-b753-debf8fee3f58 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Copying metadata from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 to 1730ce37-ea54-4418-b753-debf8fee3f58. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Creating volume glance metadata for volume 1730ce37-ea54-4418-b753-debf8fee3f58 backed by image c1c4afc1-734f-46ce-9589-8a0fba4d2421 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:00:36 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Deleted volume successfully.
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ded50eca-141d-4956-8330-ec0d8b521fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1730ce37-ea54-4418-b753-debf8fee3f58', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e76f680>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d53af0-6677-492b-80a3-2b2973ffa7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7fac91f-16cc-4f18-afe5-51111b360956 tempest-ServerRescueNegativeTestJSON-481070022 None] Lock "cinder-49b004d9-3e33-4d06-af8c-9894e0410d94-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Volume volume-1730ce37-ea54-4418-b753-debf8fee3f58 (1730ce37-ea54-4418-b753-debf8fee3f58): created successfully
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d53af0-6677-492b-80a3-2b2973ffa7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (a5c347aa-7c9b-42ee-b6f6-43dd0a9f5433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f98eeb5-302c-409e-98ba-6e25a6d1ef88 tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 06:00:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26ca0e15-88d1-4174-84fc-1cfbf21554d7 tempest-GroupSnapshotsV319Test-2089148692 None] Group tempest-GroupSnapshotsV319Test-Group-1709352269: creating
Sep 04 06:00:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26ca0e15-88d1-4174-84fc-1cfbf21554d7 tempest-GroupSnapshotsV319Test-2089148692 None] Group tempest-GroupSnapshotsV319Test-Group-1709352269: created successfully
Sep 04 06:00:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26ca0e15-88d1-4174-84fc-1cfbf21554d7 tempest-GroupSnapshotsV319Test-2089148692 None] Create group completed successfully.
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (ed847712-7cfc-40bc-9bcb-2edeb2f2f385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4771be-dda0-4e1d-96e7-508241595e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f4771be-dda0-4e1d-96e7-508241595e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1931517754',display_name='tempest-VolumesGetTest-Volume-76830623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eef0438-f339-43d9-9c11-c9521f6498fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:39Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c0d84a-e869-46c2-a2a9-7d86a84a913c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81c0d84a-e869-46c2-a2a9-7d86a84a913c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36023a36-167d-4f92-a6dd-c7909a2ac3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36023a36-167d-4f92-a6dd-c7909a2ac3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eef0438-f339-43d9-9c11-c9521f6498fb', 'volume_name': 'volume-5eef0438-f339-43d9-9c11-c9521f6498fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac7bb5-2f03-4111-b3cb-4d517e56a8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ac7bb5-2f03-4111-b3cb-4d517e56a8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda1287b-315c-44fc-b00d-0c19b8ca758c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Volume 5eef0438-f339-43d9-9c11-c9521f6498fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eef0438-f339-43d9-9c11-c9521f6498fb', 'volume_size': 1}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1931517754',display_name='tempest-VolumesGetTest-Volume-76830623',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eef0438-f339-43d9-9c11-c9521f6498fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03d907e826514ce5858778bf447328b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:39Z,use_quota=True,user_id='5750f70a5a7d421eb1e0227bcf50556a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Creating volume 5eef0438-f339-43d9-9c11-c9521f6498fb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:39 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb 1073741824
Sep 04 06:00:39 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Flow 'volume_create_manager' (fa139832-7feb-468d-b50a-45e41a60cd51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f02cf8-3b36-4562-8ca0-722b6e538349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f02cf8-3b36-4562-8ca0-722b6e538349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959417051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3960f9d2-b983-4fdd-9498-4a364245fb72,host='devstack@QuobyteHD#QuobyteHD',id=5fdd3180-9f5d-4710-9797-d05a822d2653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bb55e109464810ad7f524112cb3f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:40Z,use_quota=True,user_id='b0f71384bc8a40f0b5cbae99ff696d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cbb98e0-ffba-425d-baea-c582dfc443ee),volume_type_id=9cbb98e0-ffba-425d-baea-c582dfc443ee)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013af5a7-5af2-486a-ab75-4b1114ccd067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (013af5a7-5af2-486a-ab75-4b1114ccd067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c83eb1-7d20-44b6-a6a5-c0d6fb8423aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1c83eb1-7d20-44b6-a6a5-c0d6fb8423aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fdd3180-9f5d-4710-9797-d05a822d2653', 'volume_name': 'volume-5fdd3180-9f5d-4710-9797-d05a822d2653', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17347dd3-a521-4a69-bf74-b8b59431468a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17347dd3-a521-4a69-bf74-b8b59431468a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679727a1-1add-4e58-aa9b-295f2ade3852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Volume 5fdd3180-9f5d-4710-9797-d05a822d2653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fdd3180-9f5d-4710-9797-d05a822d2653', 'volume_size': 1}
Sep 04 06:00:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:40 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb 1073741824" returned: 0 in 0.765s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:40 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb
Sep 04 06:00:40 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:40 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.512s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=3960f9d2-b983-4fdd-9498-4a364245fb72,created_at=2026-09-04T04:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1959417051',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=3960f9d2-b983-4fdd-9498-4a364245fb72,host='devstack@QuobyteHD#QuobyteHD',id=5fdd3180-9f5d-4710-9797-d05a822d2653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48bb55e109464810ad7f524112cb3f20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:40Z,use_quota=True,user_id='b0f71384bc8a40f0b5cbae99ff696d4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9cbb98e0-ffba-425d-baea-c582dfc443ee),volume_type_id=9cbb98e0-ffba-425d-baea-c582dfc443ee)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Creating volume 5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda1287b-315c-44fc-b00d-0c19b8ca758c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eef0438-f339-43d9-9c11-c9521f6498fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:40 devstack sudo[96782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 1073741824
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31483e08-6d83-480e-951e-b27408b47476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:40 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Volume volume-5eef0438-f339-43d9-9c11-c9521f6498fb (5eef0438-f339-43d9-9c11-c9521f6498fb): created successfully
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31483e08-6d83-480e-951e-b27408b47476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Flow 'volume_create_manager' (ed847712-7cfc-40bc-9bcb-2edeb2f2f385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-25a75090-fd75-4b68-bc40-b9eddeff8423 tempest-VolumesGetTest-948025850 None] Created volume successfully.
Sep 04 06:00:41 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 1073741824" returned: 0 in 0.510s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:41 devstack sudo[96787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653
Sep 04 06:00:41 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-5eef0438-f339-43d9-9c11-c9521f6498fb-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "cinder-5eef0438-f339-43d9-9c11-c9521f6498fb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-5eef0438-f339-43d9-9c11-c9521f6498fb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:41 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-5eef0438-f339-43d9-9c11-c9521f6498fb" acquired by "delete_volume" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (679727a1-1add-4e58-aa9b-295f2ade3852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fdd3180-9f5d-4710-9797-d05a822d2653', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396cb5d9-0b8c-4271-9098-abe44c6a67e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3014154-df8e-4d04-9c68-06b21ee325cd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Volume volume-5fdd3180-9f5d-4710-9797-d05a822d2653 (5fdd3180-9f5d-4710-9797-d05a822d2653): created successfully
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (396cb5d9-0b8c-4271-9098-abe44c6a67e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Flow 'volume_create_manager' (fa139832-7feb-468d-b50a-45e41a60cd51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6db2cfc2-c29f-4c66-b412-d7440e3a7937 tempest-GroupSnapshotsV319Test-2089148692 None] Created volume successfully.
Sep 04 06:00:41 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb
Sep 04 06:00:41 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:42 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:42 devstack sudo[96817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb
Sep 04 06:00:42 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:42 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5eef0438-f339-43d9-9c11-c9521f6498fb" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-5eef0438-f339-43d9-9c11-c9521f6498fb" released by "delete_volume" :: held 0.812s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Created reservations ['2ce41d3c-1c9a-4be9-91d8-d30038ee076f', '0e009f1c-bcc0-43f1-b8d1-a4e352ab6592', 'f90f3ab2-a421-443e-b77a-e8d8078dff21', '35b2d6b7-d382-4960-aeb9-12cfe2fec7ad'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] GroupSnapshot f7b56672-1346-45e6-805d-bebf55ce84aa: creating.
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Group snapshot f7b56672-1346-45e6-805d-bebf55ce84aa: creating. {{(pid=87095) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Creating offline snapshot 812ed91f-873e-4679-a98c-4c527a599ecf of volume 5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[755436c1-f6f2-42ff-b411-b48e4681b64c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:42 devstack sudo[96821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:42 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:42 devstack sudo[96822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653
Sep 04 06:00:42 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:43 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-117b3331-da3d-4430-89f0-35ba0cdd76b9 tempest-VolumesGetTest-948025850 None] Lock "cinder-5eef0438-f339-43d9-9c11-c9521f6498fb-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:43 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:43 devstack sudo[96831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf 1G
Sep 04 06:00:43 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:43 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf 1G" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdd3180-9f5d-4710-9797-d05a822d2653 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-1730ce37-ea54-4418-b753-debf8fee3f58-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:43 devstack sudo[96837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdd3180-9f5d-4710-9797-d05a822d2653 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf
Sep 04 06:00:43 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "cinder-1730ce37-ea54-4418-b753-debf8fee3f58-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Acquiring lock "cinder-quobyte-1730ce37-ea54-4418-b753-debf8fee3f58" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-1730ce37-ea54-4418-b753-debf8fee3f58" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2af58-b406-434c-8459-3d7976a3f96f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58
Sep 04 06:00:44 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:44 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fdd3180-9f5d-4710-9797-d05a822d2653 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:44 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf
Sep 04 06:00:44 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:44 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58
Sep 04 06:00:44 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:44 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info
Sep 04 06:00:44 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:44 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1730ce37-ea54-4418-b753-debf8fee3f58" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "cinder-quobyte-1730ce37-ea54-4418-b753-debf8fee3f58" released by "delete_volume" :: held 0.730s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Created reservations ['1f66b6ce-f4c8-430a-bb7b-cf68755bead2', '662c73af-7e82-489f-b65c-e56403686baa', 'af4c0dc6-b005-4aad-9cf1-09389387f6af', 'ca00b2f0-8ef5-4169-86a5-4e9221d26db3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:44 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:44 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info is being set with open permissions: ugo+rw: NotImplementedError
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96856]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info
Sep 04 06:00:44 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:44 devstack sudo[96858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:44 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:45 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.info" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:45 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:45 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Deleted volume successfully.
Sep 04 06:00:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65487fe2-bc25-44c2-a9be-e79025fcf0d2 tempest-GroupSnapshotsV319Test-2089148692 None] group_snapshot f7b56672-1346-45e6-805d-bebf55ce84aa: created successfully
Sep 04 06:00:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-37a2810b-717f-4f9c-a165-10caa510c791 tempest-VolumesGetTest-948025850 None] Lock "cinder-1730ce37-ea54-4418-b753-debf8fee3f58-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] group_snapshot f7b56672-1346-45e6-805d-bebf55ce84aa: deleting
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] group_snapshot f7b56672-1346-45e6-805d-bebf55ce84aa: deleting {{(pid=87095) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "cinder-quobyte-812ed91f-873e-4679-a98c-4c527a599ecf" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-812ed91f-873e-4679-a98c-4c527a599ecf" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Deleting offline snapshot 812ed91f-873e-4679-a98c-4c527a599ecf of volume 5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] snapshot_file for this snap is: volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0045e66d-8d54-4a82-b6c1-b4a2cd09be17]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:46 devstack sudo[96869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf
Sep 04 06:00:46 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:46 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf" returned: 0 in 0.440s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fdd3180-9f5d-4710-9797-d05a822d2653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ef27cd-7cb9-4df9-95ba-c4243a4a5b60]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:47 devstack sudo[96874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653
Sep 04 06:00:47 devstack sudo[96874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:47 devstack sudo[96874]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:47 devstack sudo[96879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf
Sep 04 06:00:47 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:47 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:47 devstack sudo[96888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf
Sep 04 06:00:47 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:48 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653.812ed91f-873e-4679-a98c-4c527a599ecf" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-812ed91f-873e-4679-a98c-4c527a599ecf" released by "_delete_snapshot" :: held 1.716s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" released by "delete_snapshot" :: held 1.751s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:48 devstack cinder-volume[87095]: WARNING cinder.quota [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1140936584 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1140936584, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:48 devstack cinder-volume[87095]: WARNING cinder.quota [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1140936584 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1140936584, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] Created reservations ['7735f7d1-b43c-4183-ad60-2ad57c1eb716', '99539a98-656b-4d5f-a32c-190f9a4e8c84', '947762fc-2e18-48be-b7d6-ea705f60e43e', 'db85719b-b337-4985-8932-8afc552b217f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a4a71c17-cf3f-4f48-8659-6929cb8841fa tempest-GroupSnapshotsV319Test-2089148692 None] group_snapshot f7b56672-1346-45e6-805d-bebf55ce84aa: deleted successfully
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (a7bf8c99-cdd3-4ac8-b0c6-1d5c194d83d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78583a4f-107d-42dd-89e2-b6772e705eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78583a4f-107d-42dd-89e2-b6772e705eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1081737478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26934829-6d84-4191-bad6-64fab1c01ada,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:49Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8bd9f0-25f6-440a-acc4-fd624c68ee9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c8bd9f0-25f6-440a-acc4-fd624c68ee9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a254d0dc-64d6-4286-9c3d-9e3593ab3f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a254d0dc-64d6-4286-9c3d-9e3593ab3f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26934829-6d84-4191-bad6-64fab1c01ada', 'volume_name': 'volume-26934829-6d84-4191-bad6-64fab1c01ada', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574cf0d2-2c65-493d-88e2-e2710c40c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (574cf0d2-2c65-493d-88e2-e2710c40c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58152b4a-c1cd-40fd-9590-5d0880e9b8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Volume 26934829-6d84-4191-bad6-64fab1c01ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26934829-6d84-4191-bad6-64fab1c01ada', 'volume_size': 1}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1081737478',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26934829-6d84-4191-bad6-64fab1c01ada,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:49Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Creating volume 26934829-6d84-4191-bad6-64fab1c01ada {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:48 devstack sudo[96891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada 1073741824
Sep 04 06:00:48 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f24e50-b215-4888-847e-6433f3ce473d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:49 devstack sudo[96896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653
Sep 04 06:00:49 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:49 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada 1073741824" returned: 0 in 0.555s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:49 devstack sudo[96901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada
Sep 04 06:00:49 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:49 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:49 devstack sudo[96907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653
Sep 04 06:00:49 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:49 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58152b4a-c1cd-40fd-9590-5d0880e9b8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26934829-6d84-4191-bad6-64fab1c01ada', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35953835-4e30-44de-acd7-698da2726197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Volume volume-26934829-6d84-4191-bad6-64fab1c01ada (26934829-6d84-4191-bad6-64fab1c01ada): created successfully
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35953835-4e30-44de-acd7-698da2726197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (a7bf8c99-cdd3-4ac8-b0c6-1d5c194d83d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-73601d63-d01b-40ec-b7e1-22e2cf9d0982 tempest-VolumesListTestJSON-2004781572 None] Created volume successfully.
Sep 04 06:00:49 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5fdd3180-9f5d-4710-9797-d05a822d2653" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Lock "cinder-quobyte-5fdd3180-9f5d-4710-9797-d05a822d2653" released by "delete_volume" :: held 0.872s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Created reservations ['0b558097-a311-4a4d-b8bf-ad8b70d5fd64'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:50 devstack cinder-volume[87095]: WARNING cinder.quota [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1140936584 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1140936584, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Created reservations ['81ae532d-645c-4b0a-97ed-4b7de6b1cce7', 'fe4723f0-b82c-4477-a49e-8a419f099055', '56e44d1b-2288-4814-9f43-67d11e6f7133', '610f8a0c-970a-40a3-8525-f88d93d4b49f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:50 devstack sudo[96911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:00:50 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:50 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:00:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-70e5813a-70ac-4363-a4f0-5015df06e62c tempest-GroupSnapshotsV319Test-2089148692 None] Delete group completed successfully.
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (7cd8f0c3-b961-46b5-abef-4a4b67c93ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e3d4b-b266-46d8-93dd-c3ac6cdab24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a8e3d4b-b266-46d8-93dd-c3ac6cdab24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11437572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c8333-32e8-4e7c-b7fe-b98d7c09b517,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:51Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e1925-8516-4dd8-a31d-d6a21054a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559e1925-8516-4dd8-a31d-d6a21054a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab3e37-fc2e-4308-9a4a-12ddcb603a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ab3e37-fc2e-4308-9a4a-12ddcb603a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35c8333-32e8-4e7c-b7fe-b98d7c09b517', 'volume_name': 'volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956148d-6b14-46d5-9b36-c24675a831e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b956148d-6b14-46d5-9b36-c24675a831e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596b997d-52bb-4681-bf33-1380de8fecef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Volume c35c8333-32e8-4e7c-b7fe-b98d7c09b517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517', 'volume_size': 1}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-11437572',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35c8333-32e8-4e7c-b7fe-b98d7c09b517,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:51Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Creating volume c35c8333-32e8-4e7c-b7fe-b98d7c09b517 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:51 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 1073741824
Sep 04 06:00:51 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:52 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 1073741824" returned: 0 in 0.743s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:52 devstack sudo[96935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517
Sep 04 06:00:52 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:52 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" returned: 0 in 0.457s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] <== create_volume: return (1341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596b997d-52bb-4681-bf33-1380de8fecef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176667f4-492c-4b6f-8f96-6ceea0049664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Volume volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 (c35c8333-32e8-4e7c-b7fe-b98d7c09b517): created successfully
Sep 04 06:00:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176667f4-492c-4b6f-8f96-6ceea0049664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (7cd8f0c3-b961-46b5-abef-4a4b67c93ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f8d4b79-251a-44a1-aec6-bbe05875e706 tempest-VolumesListTestJSON-2004781572 None] Created volume successfully.
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (1bfb030d-2ddd-4aaf-be22-7c3802d06119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f329e2-6f49-4e6f-a850-1e59f98dc446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f329e2-6f49-4e6f-a850-1e59f98dc446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1297802982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5305f197-432d-464b-9a66-e10b10148239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:54Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54a2db2-f5c5-4fa1-8c88-0fa11944d00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b54a2db2-f5c5-4fa1-8c88-0fa11944d00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b0546-b6db-464e-9065-83ba6b861937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91b0546-b6db-464e-9065-83ba6b861937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5305f197-432d-464b-9a66-e10b10148239', 'volume_name': 'volume-5305f197-432d-464b-9a66-e10b10148239', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e4f4cb-595f-4a27-b5e1-d3075713dbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e4f4cb-595f-4a27-b5e1-d3075713dbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be883a1-155e-453d-b85c-beca1c3dd1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Volume 5305f197-432d-464b-9a66-e10b10148239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5305f197-432d-464b-9a66-e10b10148239', 'volume_size': 1}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1297802982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5305f197-432d-464b-9a66-e10b10148239,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5e3a0ceb803b4112bc9716b03971cecc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:54Z,use_quota=True,user_id='2dfb32ae87cf4ed088ec70998d1762cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Creating volume 5305f197-432d-464b-9a66-e10b10148239 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:54 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 1073741824
Sep 04 06:00:54 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:55 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 1073741824" returned: 0 in 0.565s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:55 devstack sudo[96959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239
Sep 04 06:00:55 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:55 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be883a1-155e-453d-b85c-beca1c3dd1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5305f197-432d-464b-9a66-e10b10148239', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f1f93b-6735-4184-997c-5cc51853bfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Volume volume-5305f197-432d-464b-9a66-e10b10148239 (5305f197-432d-464b-9a66-e10b10148239): created successfully
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f1f93b-6735-4184-997c-5cc51853bfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Flow 'volume_create_manager' (1bfb030d-2ddd-4aaf-be22-7c3802d06119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5b75611a-57b3-4de1-b5ba-b1215a95a27c tempest-VolumesListTestJSON-2004781572 None] Created volume successfully.
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-5305f197-432d-464b-9a66-e10b10148239-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-5305f197-432d-464b-9a66-e10b10148239-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Flow 'volume_create_manager' (59058b02-cca1-45e8-9dfc-944ac813e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1e72f-22ae-4f89-a2ce-a3e8b5f7f5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7da1e72f-22ae-4f89-a2ce-a3e8b5f7f5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-325955729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e35ad-2dff-4d8a-a43d-208738e99509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee7d491049440428b9eecc160456108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:59Z,use_quota=True,user_id='c6154071fdc744f986596400e5983b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd7c1cf-7498-44e5-97cd-3f9612084243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd7c1cf-7498-44e5-97cd-3f9612084243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae45dc-026b-4208-80c7-de88721d28ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cae45dc-026b-4208-80c7-de88721d28ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17e35ad-2dff-4d8a-a43d-208738e99509', 'volume_name': 'volume-b17e35ad-2dff-4d8a-a43d-208738e99509', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17a7eab-fc83-4a54-84f2-6fde7f153f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a17a7eab-fc83-4a54-84f2-6fde7f153f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2febc674-6c97-4ece-8d9e-88b58ff6ed4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:00:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Volume b17e35ad-2dff-4d8a-a43d-208738e99509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17e35ad-2dff-4d8a-a43d-208738e99509', 'volume_size': 1}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-325955729',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e35ad-2dff-4d8a-a43d-208738e99509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ee7d491049440428b9eecc160456108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:00:59Z,use_quota=True,user_id='c6154071fdc744f986596400e5983b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Creating volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:00:59 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-quobyte-5305f197-432d-464b-9a66-e10b10148239" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:00:59 devstack sudo[96964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 1073741824
Sep 04 06:00:59 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-5305f197-432d-464b-9a66-e10b10148239" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[982005a2-b99f-4baf-ab93-b7612ab531ef]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:00:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:00:59 devstack sudo[96966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239
Sep 04 06:00:59 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-9963fc5f-c5b5-4dea-a3fa-c26021f9249e req-4cc11f3e-4a6f-4587-b4c1-3a2f232f23bb tempest-AttachVolumeNegativeTest-522443171 None] Terminate volume connection completed successfully.
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-9963fc5f-c5b5-4dea-a3fa-c26021f9249e req-4cc11f3e-4a6f-4587-b4c1-3a2f232f23bb tempest-AttachVolumeNegativeTest-522443171 None] Deleting attachment a3056494-72a3-4730-9b52-840744999255. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:01:00 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:00 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239" returned: 0 in 0.599s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 1073741824" returned: 0 in 0.714s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:00 devstack sudo[96979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239
Sep 04 06:01:00 devstack sudo[96979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:00 devstack sudo[96982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509
Sep 04 06:01:00 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:00 devstack sudo[96979]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5305f197-432d-464b-9a66-e10b10148239" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:00 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-5305f197-432d-464b-9a66-e10b10148239" released by "delete_volume" :: held 1.048s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2febc674-6c97-4ece-8d9e-88b58ff6ed4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17e35ad-2dff-4d8a-a43d-208738e99509', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156ff30d-adb9-455b-a83f-f090e7b945e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Volume volume-b17e35ad-2dff-4d8a-a43d-208738e99509 (b17e35ad-2dff-4d8a-a43d-208738e99509): created successfully
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (156ff30d-adb9-455b-a83f-f090e7b945e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Flow 'volume_create_manager' (59058b02-cca1-45e8-9dfc-944ac813e14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d5acf929-1fd4-4c14-bb51-cd5c07efd3b3 tempest-SnapshotsActionsTest-509586299 None] Created volume successfully.
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Created reservations ['66d1f8d2-2019-4329-a320-79f7fc7128a4', '76624f5f-fc37-4f6f-a872-230291474710', '85ba7514-ae66-4928-8dac-9abe353f53db', '04468b95-47f1-471c-ac94-8366cad52174'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:00 devstack sudo[96986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:00 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:01 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Deleted volume successfully.
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4c9508be-c3ad-45bf-bdd9-2932eefe732a tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-5305f197-432d-464b-9a66-e10b10148239-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-c35c8333-32e8-4e7c-b7fe-b98d7c09b517-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-c35c8333-32e8-4e7c-b7fe-b98d7c09b517-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-quobyte-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bc0e0d-6b31-442b-9598-cd85f82c9b83]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Creating offline snapshot bf2702ae-bcc7-4372-8db6-262508d57fc4 of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf227b-4de7-4e48-9cd3-b8c28a248e8c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:02 devstack sudo[97009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517
Sep 04 06:01:02 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:02 devstack sudo[97010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509
Sep 04 06:01:02 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:02 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" returned: 0 in 0.764s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:02 devstack sudo[97019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517
Sep 04 06:01:02 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:02 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509" returned: 0 in 0.704s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:02 devstack sudo[97023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 1G
Sep 04 06:01:02 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:03 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-c35c8333-32e8-4e7c-b7fe-b98d7c09b517" released by "delete_volume" :: held 1.221s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Created reservations ['ecb7702e-0d26-4efb-8586-6a962b90843a', '3fddb82f-032a-4cf6-9b7e-b6e43c9602d3', '3927cb48-2a1e-4c9a-ad7f-43e2ee1f2a67', '0cb11866-eb88-4b24-b217-14f45aa58fa8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:03 devstack sudo[97030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:03 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:03 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 1G" returned: 0 in 0.738s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:03 devstack sudo[97033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:03 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:03 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:03 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Deleted volume successfully.
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f78a35e0-6d80-42af-bb4d-0c31c4ec8c73 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-c35c8333-32e8-4e7c-b7fe-b98d7c09b517-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:04 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.532s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:04 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 is being set with open permissions: ugo+rw
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:04 devstack sudo[97039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:04 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-26934829-6d84-4191-bad6-64fab1c01ada-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-26934829-6d84-4191-bad6-64fab1c01ada-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "cinder-quobyte-26934829-6d84-4191-bad6-64fab1c01ada" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-26934829-6d84-4191-bad6-64fab1c01ada" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b1bfe6-257f-4ee9-bf14-fbdb7b0e69e4]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:04 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:04 devstack sudo[97041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada
Sep 04 06:01:04 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:04 devstack sudo[97044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info
Sep 04 06:01:04 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:04 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:04 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info" returned: 0 in 0.313s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:04 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info is being set with open permissions: ugo+rw
Sep 04 06:01:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:04 devstack sudo[97050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada
Sep 04 06:01:04 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:04 devstack sudo[97052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info
Sep 04 06:01:04 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:05 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-26934829-6d84-4191-bad6-64fab1c01ada" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-quobyte-26934829-6d84-4191-bad6-64fab1c01ada" released by "delete_volume" :: held 0.822s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=134,cinder:SELECT=109,cinder:INSERT=36,cinder:DELETE=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=144,cinder:SELECT=125,cinder:DELETE=11,cinder:INSERT=41 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:01:05 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.info" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.180s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1d9cfc2c-777f-496b-b353-3473f6d11782 tempest-SnapshotsActionsTest-509586299 None] Create snapshot completed successfully
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Created reservations ['27ea88c2-27bc-4a54-b384-7c8c18b14e26', '0256c394-37b4-4d74-80b0-8ff07690bd6a', 'fe1644d5-abce-4b13-9818-4bb72f5a31aa', 'e6cf4099-47b5-41cf-8b69-7e1d0dfddfbe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:05 devstack sudo[97056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:05 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:05 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Deleted volume successfully.
Sep 04 06:01:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-538bcf4e-40b7-4810-b386-ad5d00ef9a54 tempest-VolumesListTestJSON-2004781572 None] Lock "cinder-26934829-6d84-4191-bad6-64fab1c01ada-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Creating offline snapshot 52e40a29-c842-4941-8e1f-f15968cf50bd of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c9889-b3a8-4d84-a987-75ea6621c4e8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:07 devstack sudo[97059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:07 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:08 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.562s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:08 devstack sudo[97065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd 1G
Sep 04 06:01:08 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:08 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd 1G" returned: 0 in 0.681s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:08 devstack sudo[97070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd
Sep 04 06:01:08 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:09 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:09 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd is being set with open permissions: ugo+rw
Sep 04 06:01:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:09 devstack sudo[97075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd
Sep 04 06:01:09 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:09 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.037s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5d9f14a9-cd95-42d8-8603-fcc30dd86992 tempest-SnapshotsActionsTest-509586299 None] Create snapshot completed successfully
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-52e40a29-c842-4941-8e1f-f15968cf50bd-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-52e40a29-c842-4941-8e1f-f15968cf50bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-52e40a29-c842-4941-8e1f-f15968cf50bd" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-52e40a29-c842-4941-8e1f-f15968cf50bd" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Deleting offline snapshot 52e40a29-c842-4941-8e1f-f15968cf50bd of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] snapshot_file for this snap is: volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd6ea55-c6a2-4798-9711-e2a8abb723aa]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:11 devstack sudo[97083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd
Sep 04 06:01:11 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:11 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9282eb4-2d75-4f1d-b829-011fd9ca271a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:11 devstack sudo[97089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:11 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:12 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.517s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:12 devstack sudo[97096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd
Sep 04 06:01:12 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:12 devstack sudo[97105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:12 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:12 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd" returned: 0 in 0.690s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:12 devstack sudo[97107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd
Sep 04 06:01:12 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:13 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.510s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:01:13 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.52e40a29-c842-4941-8e1f-f15968cf50bd" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-52e40a29-c842-4941-8e1f-f15968cf50bd" released by "_delete_snapshot" :: held 2.313s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_snapshot" :: held 2.368s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Created reservations ['403b8b42-59ea-49c9-95cd-ecffe3255029', '3ecfb097-ca12-4d45-baa4-82c2f2758fb7', 'da362250-9f37-4492-a57c-c3d40db76fa7', '4acaaabf-f692-4776-b02e-a5dceecbbc76'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Delete snapshot completed successfully.
Sep 04 06:01:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e26f33a3-9a2f-4b82-b4cd-051c61cd400b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-52e40a29-c842-4941-8e1f-f15968cf50bd-delete_snapshot" released by "delete_snapshot" :: held 2.662s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Creating offline snapshot 3b1f82db-e2f6-41af-9875-7a804fade680 of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163dbc2-5bd9-4c94-baa1-0294854191c9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:14 devstack sudo[97125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:14 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:15 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.545s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:15 devstack sudo[97131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 1G
Sep 04 06:01:15 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:15 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 1G" returned: 0 in 0.642s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:15 devstack sudo[97138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680
Sep 04 06:01:15 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:16 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680" returned: 0 in 0.723s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:16 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 is being set with open permissions: ugo+rw
Sep 04 06:01:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:16 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680
Sep 04 06:01:16 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:16 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.496s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ca92a66c-8422-4894-b02e-e47de60d475e tempest-SnapshotsActionsTest-509586299 None] Create snapshot completed successfully
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-3b1f82db-e2f6-41af-9875-7a804fade680-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-3b1f82db-e2f6-41af-9875-7a804fade680-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-3b1f82db-e2f6-41af-9875-7a804fade680" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-3b1f82db-e2f6-41af-9875-7a804fade680" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Deleting offline snapshot 3b1f82db-e2f6-41af-9875-7a804fade680 of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] snapshot_file for this snap is: volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f1f5d5-0b7e-4df3-b6f4-e77f507d1e29]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:18 devstack sudo[97214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680
Sep 04 06:01:18 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:18 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680" returned: 0 in 0.701s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[126d669e-4946-43fd-8352-5d0094be12c9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:19 devstack sudo[97220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:19 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:19 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.729s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:19 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680
Sep 04 06:01:19 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:20 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680" returned: 0 in 0.711s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:20 devstack sudo[97230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680
Sep 04 06:01:20 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:20 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.3b1f82db-e2f6-41af-9875-7a804fade680" returned: 0 in 0.460s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-3b1f82db-e2f6-41af-9875-7a804fade680" released by "_delete_snapshot" :: held 2.790s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_snapshot" :: held 2.847s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Created reservations ['86a2e420-a566-48a3-8d25-be04a1ffbce8', '275fc356-0c41-46a9-8712-1b16c3283b61', '07918cb4-dc2c-4897-aad7-be1f2a2feed2', '00807b49-fc47-4bfc-ab6e-3b4a0bb0a9a9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Delete snapshot completed successfully.
Sep 04 06:01:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97996adc-c5c2-4bbb-9bf6-690361f7a8bd tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-3b1f82db-e2f6-41af-9875-7a804fade680-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Creating offline snapshot 910efe0f-eb7d-4f10-8ad4-f599612603aa of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[334ed999-4c59-4c1e-a08d-dcd668e40423]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:22 devstack sudo[97234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:22 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:22 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.614s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:22 devstack sudo[97239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa 1G
Sep 04 06:01:22 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:23 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa 1G" returned: 0 in 0.800s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:23 devstack sudo[97244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa
Sep 04 06:01:23 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:24 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa" returned: 0 in 0.756s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa is being set with open permissions: ugo+rw
Sep 04 06:01:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:24 devstack sudo[97249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa
Sep 04 06:01:24 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:24 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa" returned: 0 in 0.454s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.952s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-78c5d58d-0c90-4380-82ea-f5ffecbbbbd9 tempest-SnapshotsActionsTest-509586299 None] Create snapshot completed successfully
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-910efe0f-eb7d-4f10-8ad4-f599612603aa-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-910efe0f-eb7d-4f10-8ad4-f599612603aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-910efe0f-eb7d-4f10-8ad4-f599612603aa" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-910efe0f-eb7d-4f10-8ad4-f599612603aa" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Deleting offline snapshot 910efe0f-eb7d-4f10-8ad4-f599612603aa of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] snapshot_file for this snap is: volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683541c-abb9-4332-9e05-e983d5bd9d2e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:26 devstack sudo[97252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa
Sep 04 06:01:26 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (efd34169-6dc2-4711-973c-c55bae8dedf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e744bd0-cdfc-4483-a8cb-7ffbc55d2c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e744bd0-cdfc-4483-a8cb-7ffbc55d2c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306407595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b40041-76b1-400e-9fcd-3dca22b7891e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:27Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:27 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ffd1ba-8a05-4d98-8a4e-0e254d28dbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0ffd1ba-8a05-4d98-8a4e-0e254d28dbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53fec1-e07b-4cbc-b897-843b55257f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a53fec1-e07b-4cbc-b897-843b55257f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b40041-76b1-400e-9fcd-3dca22b7891e', 'volume_name': 'volume-76b40041-76b1-400e-9fcd-3dca22b7891e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcc6e25-d85a-4264-863c-4777ebe18952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dcc6e25-d85a-4264-863c-4777ebe18952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c01222a-6417-486f-8923-5a0233cdf0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Volume 76b40041-76b1-400e-9fcd-3dca22b7891e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b40041-76b1-400e-9fcd-3dca22b7891e', 'volume_size': 1}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-306407595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b40041-76b1-400e-9fcd-3dca22b7891e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:27Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Creating volume 76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa" returned: 0 in 0.786s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:27 devstack sudo[97257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e 1073741824
Sep 04 06:01:27 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f508a1-a403-4983-b69a-5415416a3bf6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:27 devstack sudo[97259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:27 devstack sudo[97259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:28 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e 1073741824" returned: 0 in 0.870s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:28 devstack sudo[97259]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.840s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:28 devstack sudo[97304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa
Sep 04 06:01:28 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:28 devstack sudo[97306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e
Sep 04 06:01:28 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:28 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c01222a-6417-486f-8923-5a0233cdf0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b40041-76b1-400e-9fcd-3dca22b7891e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51336568-5a09-44ec-a322-5ed3e56813bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Volume volume-76b40041-76b1-400e-9fcd-3dca22b7891e (76b40041-76b1-400e-9fcd-3dca22b7891e): created successfully
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51336568-5a09-44ec-a322-5ed3e56813bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (efd34169-6dc2-4711-973c-c55bae8dedf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eac65e35-009a-4a96-8a47-998fc14a1a64 tempest-VolumesSnapshotTestJSON-56884914 None] Created volume successfully.
Sep 04 06:01:29 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa" returned: 0 in 0.818s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:29 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa
Sep 04 06:01:29 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:29 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.910efe0f-eb7d-4f10-8ad4-f599612603aa" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-910efe0f-eb7d-4f10-8ad4-f599612603aa" released by "_delete_snapshot" :: held 3.121s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_snapshot" :: held 3.169s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Creating offline snapshot bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f of volume 76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4459b668-313a-448d-87d5-6757fb2834d9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Created reservations ['01d59cf9-b1f2-41b9-a875-0d068c5a6edd', '41311b7c-3613-4666-95a1-c2bb254cd9ae', '2c543169-3a97-4c56-a421-037bfb49618b', 'a6acd6d8-af12-4801-a1a2-f86e50a44d57'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:29 devstack sudo[97318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e
Sep 04 06:01:29 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Delete snapshot completed successfully.
Sep 04 06:01:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e9a77e81-a984-4bcd-97ed-63b536c7a5ea tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-910efe0f-eb7d-4f10-8ad4-f599612603aa-delete_snapshot" released by "delete_snapshot" :: held 3.511s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:30 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:30 devstack sudo[97324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f 1G
Sep 04 06:01:30 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:30 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f 1G" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b40041-76b1-400e-9fcd-3dca22b7891e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:30 devstack sudo[97359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b40041-76b1-400e-9fcd-3dca22b7891e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f
Sep 04 06:01:30 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:31 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76b40041-76b1-400e-9fcd-3dca22b7891e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f is being set with open permissions: ugo+rw
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:31 devstack sudo[97364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f
Sep 04 06:01:31 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:31 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" returned: 0 in 0.238s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:31 devstack sudo[97367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info
Sep 04 06:01:31 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:31 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:31 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info is being set with open permissions: ugo+rw
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:31 devstack sudo[97370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info
Sep 04 06:01:31 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:31 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.info" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.270s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.794s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Creating offline snapshot 49c8e758-8156-4057-96b8-0e712ffdb23e of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e567d-139a-4c4f-b61a-58c5ce1f7cb8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-58cd79eb-f663-4540-92a1-94e23beb4eed tempest-VolumesSnapshotTestJSON-56884914 None] Create snapshot completed successfully
Sep 04 06:01:32 devstack sudo[97373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:32 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:32 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:32 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e 1G
Sep 04 06:01:32 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:32 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e 1G" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:32 devstack sudo[97384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e
Sep 04 06:01:32 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Deleting offline snapshot bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f of volume 76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] snapshot_file for this snap is: volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[329d6353-6031-4e33-bdd1-94cf2ebebc9b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:33 devstack sudo[97386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f
Sep 04 06:01:33 devstack sudo[97386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:33 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:33 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e is being set with open permissions: ugo+rw
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:33 devstack sudo[97391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e
Sep 04 06:01:33 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:33 devstack sudo[97386]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76b40041-76b1-400e-9fcd-3dca22b7891e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea57289-e9ef-4ee1-a065-0923d397cf6f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:33 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.641s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9283f3e3-473b-4141-bbdc-c424f2845402 tempest-SnapshotsActionsTest-509586299 None] Create snapshot completed successfully
Sep 04 06:01:33 devstack sudo[97397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e
Sep 04 06:01:33 devstack sudo[97397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:33 devstack sudo[97397]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:33 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f
Sep 04 06:01:33 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:34 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:34 devstack sudo[97409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f
Sep 04 06:01:34 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-49c8e758-8156-4057-96b8-0e712ffdb23e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-49c8e758-8156-4057-96b8-0e712ffdb23e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Acquiring lock "cinder-quobyte-49c8e758-8156-4057-96b8-0e712ffdb23e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-49c8e758-8156-4057-96b8-0e712ffdb23e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Deleting offline snapshot 49c8e758-8156-4057-96b8-0e712ffdb23e of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] snapshot_file for this snap is: volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[786288d9-e4f2-49e6-a02f-7441d272f834]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:34 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e.bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:34 devstack sudo[97411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e
Sep 04 06:01:34 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f" released by "_delete_snapshot" :: held 1.663s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" released by "delete_snapshot" :: held 1.689s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['2d276ca0-03c2-4b3e-be0b-686b9c4242d7', '587e7df3-f914-4d36-97d1-d410da235dc4', 'ff9c4357-815d-4abd-a1b6-e54afe8f40cb', '596b0696-a6a5-454b-a773-696667a4fb4a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Delete snapshot completed successfully.
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6a7e977c-4ec0-4ce8-b227-57b7fe40dc87 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-bd41e23d-bb0a-4ed5-9f98-2c91ad54ab3f-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:34 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e" returned: 0 in 0.464s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad566a21-6406-4b11-9ae8-801e2446464e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:35 devstack sudo[97417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:35 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:35 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:35 devstack sudo[97422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e
Sep 04 06:01:35 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (80d21931-9bcd-4508-9df7-bf0b9ccf46c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c1b7f-4038-46ad-b48d-9af8b43fa247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c0c1b7f-4038-46ad-b48d-9af8b43fa247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115719078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca834c5-9175-4856-bfb0-9d4eab28133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:36Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd5f14e-793a-486d-89cc-17fd66b82104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd5f14e-793a-486d-89cc-17fd66b82104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505c8dc0-b245-42e4-ab4f-cfc39e293e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505c8dc0-b245-42e4-ab4f-cfc39e293e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca834c5-9175-4856-bfb0-9d4eab28133e', 'volume_name': 'volume-7ca834c5-9175-4856-bfb0-9d4eab28133e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290e0865-af12-4bdb-a70f-cbd352c8499a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290e0865-af12-4bdb-a70f-cbd352c8499a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8643e4ab-9beb-47aa-8576-1399a6cee737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Volume 7ca834c5-9175-4856-bfb0-9d4eab28133e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca834c5-9175-4856-bfb0-9d4eab28133e', 'volume_size': 1}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2115719078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca834c5-9175-4856-bfb0-9d4eab28133e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:36Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Creating volume 7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:35 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:35 devstack sudo[97429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e 1073741824
Sep 04 06:01:35 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:35 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:35 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e
Sep 04 06:01:35 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:36 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.49c8e758-8156-4057-96b8-0e712ffdb23e" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-49c8e758-8156-4057-96b8-0e712ffdb23e" released by "_delete_snapshot" :: held 1.799s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_snapshot" :: held 1.826s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Created reservations ['604856ff-206a-41d0-9955-0e5bc83b3f70', 'c77f3643-defa-429c-b6d4-150f5c0bcf03', 'a5530dda-5c84-4dc4-81a9-b0d5fdfb012c', 'a07ad9a1-8cf0-44e7-92b4-d504d4f421f2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Delete snapshot completed successfully.
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ea511c47-27ac-48e7-ba9d-18a9110bc70b tempest-SnapshotsActionsTest-1829735791 None] Lock "cinder-49c8e758-8156-4057-96b8-0e712ffdb23e-delete_snapshot" released by "delete_snapshot" :: held 2.023s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:36 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e 1073741824" returned: 0 in 0.594s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:36 devstack sudo[97438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:36 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:36 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8643e4ab-9beb-47aa-8576-1399a6cee737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca834c5-9175-4856-bfb0-9d4eab28133e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9428f3-dd0e-41a2-ac1b-6a4eebba2e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Volume volume-7ca834c5-9175-4856-bfb0-9d4eab28133e (7ca834c5-9175-4856-bfb0-9d4eab28133e): created successfully
Sep 04 06:01:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd9428f3-dd0e-41a2-ac1b-6a4eebba2e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (80d21931-9bcd-4508-9df7-bf0b9ccf46c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2458d7a4-2ae0-490a-ae50-08b95bdd5297 tempest-VolumesSnapshotTestJSON-56884914 None] Created volume successfully.
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "cinder-bf2702ae-bcc7-4372-8db6-262508d57fc4-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-bf2702ae-bcc7-4372-8db6-262508d57fc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "cinder-quobyte-bf2702ae-bcc7-4372-8db6-262508d57fc4" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-bf2702ae-bcc7-4372-8db6-262508d57fc4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Deleting offline snapshot bf2702ae-bcc7-4372-8db6-262508d57fc4 of volume b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] snapshot_file for this snap is: volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08139ba-e19d-42a0-bead-36ff3d4b1274]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:37 devstack sudo[97441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:37 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:37 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e35ad-2dff-4d8a-a43d-208738e99509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b615b492-3a73-4aaf-b59e-8117374802e5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:37 devstack sudo[97446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509
Sep 04 06:01:37 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Creating offline snapshot 3a42af50-0271-43f3-a0a6-ee78dc7aa71b of volume 7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d5f5c3-dd7e-492c-9a2c-0b0efa06a3bf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:38 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:38 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:38 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:38 devstack sudo[97452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:38 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:38 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:38 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b 1G
Sep 04 06:01:38 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:38 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:38 devstack sudo[97463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4
Sep 04 06:01:38 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:38 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509.bf2702ae-bcc7-4372-8db6-262508d57fc4" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-bf2702ae-bcc7-4372-8db6-262508d57fc4" released by "_delete_snapshot" :: held 1.737s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_snapshot" :: held 1.768s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:39 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b 1G" returned: 0 in 0.518s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca834c5-9175-4856-bfb0-9d4eab28133e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Created reservations ['0cb39581-763c-4959-a4b0-0bc56828beea', '2a9b7ed5-a088-42dc-bab2-3815a876847d', '7e03ba13-61c5-4549-8355-804d1d7bfa38', 'f92d3498-a730-4f24-be7b-f8301b45a10e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:39 devstack sudo[97472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca834c5-9175-4856-bfb0-9d4eab28133e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:39 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Delete snapshot completed successfully.
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-063007ec-6d54-4ada-a7c3-0aebe5e5ac85 tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-bf2702ae-bcc7-4372-8db6-262508d57fc4-delete_snapshot" released by "delete_snapshot" :: held 1.976s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "cinder-b17e35ad-2dff-4d8a-a43d-208738e99509-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-b17e35ad-2dff-4d8a-a43d-208738e99509-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:39 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca834c5-9175-4856-bfb0-9d4eab28133e -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:39 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b is being set with open permissions: ugo+rw
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:39 devstack sudo[97478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:39 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0d5bce-9e60-4553-9050-4ade62a45ad3]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (8251133e-d84f-446b-b601-54b041ee3c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ed1ff7-3e58-4bbd-a766-25c39d85c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66ed1ff7-3e58-4bbd-a766-25c39d85c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2084553033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742d5539-d8e6-48c4-aebf-b6bc5c997445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4cba2-bc14-40d7-a2bf-1e40cda80ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e4cba2-bc14-40d7-a2bf-1e40cda80ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc7856b-72a9-46ac-ba98-5d0407ddebce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc7856b-72a9-46ac-ba98-5d0407ddebce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742d5539-d8e6-48c4-aebf-b6bc5c997445', 'volume_name': 'volume-742d5539-d8e6-48c4-aebf-b6bc5c997445', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34433b0-a159-41a2-acfc-013ee02a699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:39 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509
Sep 04 06:01:39 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f34433b0-a159-41a2-acfc-013ee02a699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff224826-f28e-43cb-b59f-7cf50402b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Volume 742d5539-d8e6-48c4-aebf-b6bc5c997445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742d5539-d8e6-48c4-aebf-b6bc5c997445', 'volume_size': 1}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:39 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:39 devstack sudo[97483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info
Sep 04 06:01:39 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:40 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509" returned: 0 in 0.433s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:40 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509
Sep 04 06:01:40 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:40 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:40 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info is being set with open permissions: ugo+rw
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:40 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info
Sep 04 06:01:40 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:40 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b17e35ad-2dff-4d8a-a43d-208738e99509" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-quobyte-b17e35ad-2dff-4d8a-a43d-208738e99509" released by "delete_volume" :: held 0.805s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Created reservations ['364e8a5a-1787-4828-b32f-a0009e864ec0', '14540c68-136d-4489-bd1f-2139f3a9c5f4', '3c0bcb30-60ad-462f-9afb-99825f274f97', '3b108970-e981-49c0-bd61-5af74927b77d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:40 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.info" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.410s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.734s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2084553033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742d5539-d8e6-48c4-aebf-b6bc5c997445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:40Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Creating volume 742d5539-d8e6-48c4-aebf-b6bc5c997445 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:40 devstack sudo[97496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 1073741824
Sep 04 06:01:40 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e28997c4-9084-44c3-8d23-618c2099e571 tempest-VolumesSnapshotTestJSON-56884914 None] Create snapshot completed successfully
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Flow 'volume_create_manager' (467747b8-60f0-438c-8fde-1902fac88f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dcec34-6554-4215-abca-8e7afeb237f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:40 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:40 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dcec34-6554-4215-abca-8e7afeb237f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1635453901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82b73b3-3140-4dd3-8647-43fac8369102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf9661534c94efe95cc8b647d70bd9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:41Z,use_quota=True,user_id='b6cb051a521344a3a9ee5cb81fbbb21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd103358-ccd5-4882-8615-093e80abf4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd103358-ccd5-4882-8615-093e80abf4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652c3310-e0a3-4d06-8eef-c75b903cc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652c3310-e0a3-4d06-8eef-c75b903cc394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82b73b3-3140-4dd3-8647-43fac8369102', 'volume_name': 'volume-b82b73b3-3140-4dd3-8647-43fac8369102', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551571e8-5957-4720-b09a-07e36d4ac17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (551571e8-5957-4720-b09a-07e36d4ac17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed42b97-c77a-4ca5-9624-908014793680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Volume b82b73b3-3140-4dd3-8647-43fac8369102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82b73b3-3140-4dd3-8647-43fac8369102', 'volume_size': 1}
Sep 04 06:01:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:41 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Deleted volume successfully.
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e317dfef-fb6f-4b6b-bbe2-f3b2ec9e10ec tempest-SnapshotsActionsTest-509586299 None] Lock "cinder-b17e35ad-2dff-4d8a-a43d-208738e99509-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:41 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 1073741824" returned: 0 in 0.529s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:41 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445
Sep 04 06:01:41 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:41 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1635453901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82b73b3-3140-4dd3-8647-43fac8369102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edf9661534c94efe95cc8b647d70bd9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:41Z,use_quota=True,user_id='b6cb051a521344a3a9ee5cb81fbbb21a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Creating volume b82b73b3-3140-4dd3-8647-43fac8369102 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff224826-f28e-43cb-b59f-7cf50402b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742d5539-d8e6-48c4-aebf-b6bc5c997445', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:41 devstack sudo[97508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 1073741824
Sep 04 06:01:41 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9645f647-4854-44d5-80fc-4213af7e28a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Volume volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 (742d5539-d8e6-48c4-aebf-b6bc5c997445): created successfully
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9645f647-4854-44d5-80fc-4213af7e28a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (8251133e-d84f-446b-b601-54b041ee3c62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7b9277e9-5655-4305-a412-b95e708b7e51 tempest-AttachVolumeNegativeTest-522443171 None] Created volume successfully.
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (a673a885-4db8-4b7f-a01f-02b92eb4904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2c5394-bfd7-4676-a803-5acb5b80cd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b2c5394-bfd7-4676-a803-5acb5b80cd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1287777125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060e5bd4-9b41-48b0-ad4e-eb3c2427c17d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3a42af50-0271-43f3-a0a6-ee78dc7aa71b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:42Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ec4aab-9a5f-428b-9c41-9b2f66685e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ec4aab-9a5f-428b-9c41-9b2f66685e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9507febd-db14-4629-aa65-06d3041e7019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9507febd-db14-4629-aa65-06d3041e7019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '060e5bd4-9b41-48b0-ad4e-eb3c2427c17d', 'volume_name': 'volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d', 'volume_size': 2, 'snapshot_id': '3a42af50-0271-43f3-a0a6-ee78dc7aa71b'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e31989-ced3-43c7-9572-a62fa1239a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e31989-ced3-43c7-9572-a62fa1239a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bb1e4d-dc62-4edd-adda-f9363b136c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Volume 060e5bd4-9b41-48b0-ad4e-eb3c2427c17d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d', 'volume_size': 2, 'snapshot_id': '3a42af50-0271-43f3-a0a6-ee78dc7aa71b'}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:42 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 1073741824" returned: 0 in 0.687s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:42 devstack sudo[97517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102
Sep 04 06:01:42 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:42 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.363s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed42b97-c77a-4ca5-9624-908014793680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82b73b3-3140-4dd3-8647-43fac8369102', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe13bfd-09cc-410a-8302-99a87d49993a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Creating volume 060e5bd4-9b41-48b0-ad4e-eb3c2427c17d from snapshot 3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Volume volume-b82b73b3-3140-4dd3-8647-43fac8369102 (b82b73b3-3140-4dd3-8647-43fac8369102): created successfully
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fe13bfd-09cc-410a-8302-99a87d49993a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Flow 'volume_create_manager' (467747b8-60f0-438c-8fde-1902fac88f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] snapshot: 3a42af50-0271-43f3-a0a6-ee78dc7aa71b, volume: 060e5bd4-9b41-48b0-ad4e-eb3c2427c17d,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:01:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9ddce80e-7cc0-4b4f-b766-76f5d7973de9 tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Created volume successfully.
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[250167f2-e58a-44b8-b231-c8de9f3338f6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:42 devstack sudo[97521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:42 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6c2a8fc7-f2a6-4b27-84a4-ffa717504951 req-58f749b2-a96a-4c7f-af9c-b233b3dbfd8a tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:43 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca834c5-9175-4856-bfb0-9d4eab28133e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a01829-4eb2-46dc-be32-e66675654405]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:43 devstack sudo[97534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:43 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:43 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:43 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d
Sep 04 06:01:43 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Acquiring lock "cinder-b82b73b3-3140-4dd3-8647-43fac8369102-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "cinder-b82b73b3-3140-4dd3-8647-43fac8369102-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Acquiring lock "cinder-quobyte-b82b73b3-3140-4dd3-8647-43fac8369102" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "cinder-quobyte-b82b73b3-3140-4dd3-8647-43fac8369102" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a6bd7d-9f9a-4856-874b-7d80fc9993f9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:44 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102
Sep 04 06:01:44 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:44 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102" returned: 0 in 0.818s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:45 devstack sudo[97556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102
Sep 04 06:01:45 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:45 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b82b73b3-3140-4dd3-8647-43fac8369102" returned: 0 in 0.798s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "cinder-quobyte-b82b73b3-3140-4dd3-8647-43fac8369102" released by "delete_volume" :: held 1.703s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Created reservations ['22524319-d1bf-47ab-ad59-63e0f4b7fc4e', '2ecd10cf-733e-48f1-96e0-b85d3701b3eb', 'da4f1040-65c0-429c-a334-1995377bc29b', 'c92fa6da-0110-4ce6-9161-0312bbd64cfc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:46 devstack sudo[97560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:46 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:47 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.784s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:47 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Deleted volume successfully.
Sep 04 06:01:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1d03eebf-3c54-4f74-b954-8af9bdf6b96f tempest-VolumeQuotasNegativeTestJSON-2075788872 None] Lock "cinder-b82b73b3-3140-4dd3-8647-43fac8369102-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:49 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" returned: 0 in 5.939s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:01:49 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Converted 1024.00 MB image at 172.39 MB/s
Sep 04 06:01:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d is being set with open permissions: ugo+rw
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:49 devstack sudo[97569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d
Sep 04 06:01:49 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:49 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" released by "_copy_volume_from_snapshot" :: held 7.228s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" released by "_create_volume_from_snapshot" :: held 7.368s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.405s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6c2a8fc7-f2a6-4b27-84a4-ffa717504951 req-58f749b2-a96a-4c7f-af9c-b233b3dbfd8a tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.890s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-6c2a8fc7-f2a6-4b27-84a4-ffa717504951 req-58f749b2-a96a-4c7f-af9c-b233b3dbfd8a tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9bb1e4d-dc62-4edd-adda-f9363b136c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d', 'volume_size': 2, 'snapshot_id': '3a42af50-0271-43f3-a0a6-ee78dc7aa71b'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ece0ac1-0cea-448e-ae66-532e24622eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Volume volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d (060e5bd4-9b41-48b0-ad4e-eb3c2427c17d): created successfully
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ece0ac1-0cea-448e-ae66-532e24622eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (a673a885-4db8-4b7f-a01f-02b92eb4904e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6c2a8fc7-f2a6-4b27-84a4-ffa717504951 req-58f749b2-a96a-4c7f-af9c-b233b3dbfd8a tempest-AttachVolumeNegativeTest-522443171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-742d5539-d8e6-48c4-aebf-b6bc5c997445', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03cd29e5-e72b-4a63-b2bb-34bd462fa764', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:01:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-41eac931-bebb-4397-92e6-b14d423542a3 tempest-VolumesSnapshotTestJSON-56884914 None] Created volume successfully.
Sep 04 06:01:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6c2a8fc7-f2a6-4b27-84a4-ffa717504951 req-58f749b2-a96a-4c7f-af9c-b233b3dbfd8a tempest-AttachVolumeNegativeTest-522443171 None] attachment_update completed successfully.
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Flow 'volume_create_manager' (aef2cf77-467c-434e-908d-ead32daa954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aada2655-799e-4d22-b79b-57939882d2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aada2655-799e-4d22-b79b-57939882d2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-819860764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2f7b52-3731-4549-b04a-ddd6558f2e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cda223a0424622a6c6bffd22cb0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:51Z,use_quota=True,user_id='46d505458aa84a60afff402d959dc65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3530e5-827a-4d38-97d0-c98d33011f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3530e5-827a-4d38-97d0-c98d33011f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581a0546-92fa-4e54-80ba-fa414f84b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (581a0546-92fa-4e54-80ba-fa414f84b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2f7b52-3731-4549-b04a-ddd6558f2e6c', 'volume_name': 'volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d980004-049d-4967-9914-ba1a0d857158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d980004-049d-4967-9914-ba1a0d857158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5658176-7ecf-403c-a3ba-69891a3d369f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Volume ef2f7b52-3731-4549-b04a-ddd6558f2e6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c', 'volume_size': 1}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-819860764',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2f7b52-3731-4549-b04a-ddd6558f2e6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43cda223a0424622a6c6bffd22cb0da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:51Z,use_quota=True,user_id='46d505458aa84a60afff402d959dc65b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Creating volume ef2f7b52-3731-4549-b04a-ddd6558f2e6c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:51 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c 1073741824
Sep 04 06:01:51 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a75f982-8181-4235-aa43-fca236d8f025]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:51 devstack sudo[97961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d
Sep 04 06:01:51 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:51 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c 1073741824" returned: 0 in 0.576s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:51 devstack sudo[97964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c
Sep 04 06:01:51 devstack sudo[97964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:52 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" returned: 0 in 0.607s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:52 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d
Sep 04 06:01:52 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:52 devstack sudo[97964]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5658176-7ecf-403c-a3ba-69891a3d369f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1d5528-b870-4043-b19d-2cb9c433efbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Volume volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c (ef2f7b52-3731-4549-b04a-ddd6558f2e6c): created successfully
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d1d5528-b870-4043-b19d-2cb9c433efbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Flow 'volume_create_manager' (aef2cf77-467c-434e-908d-ead32daa954d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-56d00c81-bd43-43e2-b11c-aa754f2a9f6f tempest-VolumesServicesTestJSON-188149038 None] Created volume successfully.
Sep 04 06:01:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-71c4a874-8615-4e7a-a3e3-5e4fea4015be req-7696fdef-3372-4e88-97ad-ea34564d588d tempest-AttachVolumeNegativeTest-522443171 None] Terminate volume connection completed successfully.
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-71c4a874-8615-4e7a-a3e3-5e4fea4015be req-7696fdef-3372-4e88-97ad-ea34564d588d tempest-AttachVolumeNegativeTest-522443171 None] Deleting attachment 03cd29e5-e72b-4a63-b2bb-34bd462fa764. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:01:52 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d" released by "delete_volume" :: held 0.997s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['1ae3ef95-9e0a-4643-a6e6-bd1dc7356036', '53a4a000-c35a-422b-9819-620b5f6d6d9f', '10d96744-1726-4495-91c3-1f76d694f835', '4a13e877-bec8-4370-8ef9-b9e5140f3aef'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:52 devstack sudo[97999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:52 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:52 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Deleted volume successfully.
Sep 04 06:01:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-40070130-6b6d-4b07-b267-c029fe3c68da tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-060e5bd4-9b41-48b0-ad4e-eb3c2427c17d-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Acquiring lock "cinder-ef2f7b52-3731-4549-b04a-ddd6558f2e6c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "cinder-ef2f7b52-3731-4549-b04a-ddd6558f2e6c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Acquiring lock "cinder-quobyte-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "cinder-quobyte-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd218a5-6c98-47de-a39d-3ce3a4c3c0e7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:53 devstack sudo[98004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c
Sep 04 06:01:53 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Deleting offline snapshot 3a42af50-0271-43f3-a0a6-ee78dc7aa71b of volume 7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] snapshot_file for this snap is: volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[46431afd-3368-40dd-9080-18f943779b0a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:54 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" returned: 0 in 0.746s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:54 devstack sudo[98023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:54 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:54 devstack sudo[98028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c
Sep 04 06:01:54 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:54 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:54 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.688s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca834c5-9175-4856-bfb0-9d4eab28133e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "cinder-quobyte-ef2f7b52-3731-4549-b04a-ddd6558f2e6c" released by "delete_volume" :: held 1.281s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251210e-109f-41d0-afc1-2d92e27e5462]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Created reservations ['6274137d-fc6c-4092-b522-599c9001ddc2', 'dd60755f-1c6e-4803-885e-2a47256dc00e', 'd0732943-000c-4bd7-aa17-d5c542d90d65', '9220af65-a9bb-4115-8be0-2be3fcb758ca'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:54 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:54 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:54 devstack sudo[98039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:54 devstack sudo[98039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:55 devstack sudo[98039]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Deleted volume successfully.
Sep 04 06:01:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d8fb674d-3766-4b87-bb79-5c63c135199d tempest-VolumesServicesTestJSON-188149038 None] Lock "cinder-ef2f7b52-3731-4549-b04a-ddd6558f2e6c-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:55 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.767s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:55 devstack sudo[98046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:55 devstack sudo[98046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:56 devstack sudo[98046]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.635s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:56 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b
Sep 04 06:01:56 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:56 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e.3a42af50-0271-43f3-a0a6-ee78dc7aa71b" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-3a42af50-0271-43f3-a0a6-ee78dc7aa71b" released by "_delete_snapshot" :: held 2.676s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Flow 'volume_create_manager' (373bfc9e-6ea8-4074-9e84-4eafe72f594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aec39c6-051f-4b8b-a673-53d53dd27ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" released by "delete_snapshot" :: held 2.736s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6aec39c6-051f-4b8b-a673-53d53dd27ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1867263178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e1c9a3-0f78-49dd-8018-c28b504b3b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f997e797b2b4ee3a34f72a3481ea28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:56Z,use_quota=True,user_id='fa1a9cbe79f7499d9974d407f1eda235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38a92f0e-fe55-4b93-b5af-d813d3a75826),volume_type_id=38a92f0e-fe55-4b93-b5af-d813d3a75826)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60b25e2-382c-4a96-9814-a01de19e00c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d60b25e2-382c-4a96-9814-a01de19e00c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b7dcc3-f11c-4da6-85a9-2f53c5be6500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41b7dcc3-f11c-4da6-85a9-2f53c5be6500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e1c9a3-0f78-49dd-8018-c28b504b3b59', 'volume_name': 'volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b37607-2751-4506-8fea-524bb5f7e293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b37607-2751-4506-8fea-524bb5f7e293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9907a5-cf4a-413d-bf50-96c0ec031d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Volume 72e1c9a3-0f78-49dd-8018-c28b504b3b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59', 'volume_size': 1}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1867263178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e1c9a3-0f78-49dd-8018-c28b504b3b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f997e797b2b4ee3a34f72a3481ea28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:01:56Z,use_quota=True,user_id='fa1a9cbe79f7499d9974d407f1eda235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38a92f0e-fe55-4b93-b5af-d813d3a75826),volume_type_id=38a92f0e-fe55-4b93-b5af-d813d3a75826)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Creating volume 72e1c9a3-0f78-49dd-8018-c28b504b3b59 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:01:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:56 devstack sudo[98054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 1073741824
Sep 04 06:01:56 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['e5c2f553-ee16-46ce-bd2f-1a6e93e67ce2', '51d268f3-d765-48d5-91d9-02167b8a410d', '5006ac7e-03c6-4208-b082-a3e876ff7eab', 'fe149f97-e8fa-4641-8119-35462f63befc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Delete snapshot completed successfully.
Sep 04 06:01:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bd621e73-b349-4e9b-b35b-d5ae703b9884 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-3a42af50-0271-43f3-a0a6-ee78dc7aa71b-delete_snapshot" released by "delete_snapshot" :: held 2.997s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-7ca834c5-9175-4856-bfb0-9d4eab28133e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-7ca834c5-9175-4856-bfb0-9d4eab28133e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:57 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 1073741824" returned: 0 in 0.557s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4116d101-7bf9-4b4c-9684-0ad41b4c9561]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:57 devstack sudo[98060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59
Sep 04 06:01:57 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:57 devstack sudo[98061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:57 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:57 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e9907a5-cf4a-413d-bf50-96c0ec031d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0680b8-a6d9-4828-88d6-faf8c8c2f7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:01:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Volume volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 (72e1c9a3-0f78-49dd-8018-c28b504b3b59): created successfully
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad0680b8-a6d9-4828-88d6-faf8c8c2f7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Flow 'volume_create_manager' (373bfc9e-6ea8-4074-9e84-4eafe72f594c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:01:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb5ca5a4-d6fd-4770-b13f-45246de8efcb tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Created volume successfully.
Sep 04 06:01:57 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:57 devstack sudo[98068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e
Sep 04 06:01:57 devstack sudo[98068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:58 devstack sudo[98068]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7ca834c5-9175-4856-bfb0-9d4eab28133e" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-7ca834c5-9175-4856-bfb0-9d4eab28133e" released by "delete_volume" :: held 0.978s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['3cae9445-442b-4bca-af82-71a46c5b3779', 'f162f1be-b1ed-4366-b817-ddedc90b57bd', 'c798b374-1e4e-4c7d-b86e-17c4e872067d', '4cdd5476-9100-4006-a686-d3cd6016f945'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:58 devstack sudo[98071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:58 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:58 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Deleted volume successfully.
Sep 04 06:01:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-dd4d2d95-eb32-495a-8904-6948464d9c5a tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-7ca834c5-9175-4856-bfb0-9d4eab28133e-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:01:59 devstack sudo[98074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:01:59 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:01:59 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:01:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:01:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-302b8434-49d9-4ea1-8833-1c186688c71f tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Retype volume completed successfully.
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (fb01f612-e87f-44a3-885b-98c8699b7fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a72b2f-18aa-49e8-8644-b7788f77ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a72b2f-18aa-49e8-8644-b7788f77ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1261498543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8770a2b8-1f2d-41a4-983e-a57daddbfc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:00Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6167bd9-cd44-4c8e-a453-5861746d8b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6167bd9-cd44-4c8e-a453-5861746d8b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4aaff3-0211-470f-9c7a-cf032bd39f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4aaff3-0211-470f-9c7a-cf032bd39f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8770a2b8-1f2d-41a4-983e-a57daddbfc20', 'volume_name': 'volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa96657-b665-4f2b-ab59-e2e8d9905529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aaa96657-b665-4f2b-ab59-e2e8d9905529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d57d1d-1e38-4d10-8b18-ddde6a51c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Volume 8770a2b8-1f2d-41a4-983e-a57daddbfc20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20', 'volume_size': 1}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1261498543',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8770a2b8-1f2d-41a4-983e-a57daddbfc20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:00Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Creating volume 8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:02:00 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:00 devstack sudo[98077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 1073741824
Sep 04 06:02:00 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "cinder-72e1c9a3-0f78-49dd-8018-c28b504b3b59-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "cinder-72e1c9a3-0f78-49dd-8018-c28b504b3b59-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:00 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "cinder-quobyte-72e1c9a3-0f78-49dd-8018-c28b504b3b59" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 1073741824" returned: 0 in 0.592s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "cinder-quobyte-72e1c9a3-0f78-49dd-8018-c28b504b3b59" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce7b888-649e-4d44-959a-e55ad15a597a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:00 devstack sudo[98084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:00 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:00 devstack sudo[98083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59
Sep 04 06:02:00 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:01 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d57d1d-1e38-4d10-8b18-ddde6a51c435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d088afdf-d210-4b16-8bc0-41e619033337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Volume volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 (8770a2b8-1f2d-41a4-983e-a57daddbfc20): created successfully
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d088afdf-d210-4b16-8bc0-41e619033337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (fb01f612-e87f-44a3-885b-98c8699b7fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9ff2592a-9f3b-4349-8476-b5979612a972 tempest-VolumesSnapshotTestJSON-56884914 None] Created volume successfully.
Sep 04 06:02:01 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59" returned: 0 in 0.511s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:01 devstack sudo[98091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59
Sep 04 06:02:01 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:01 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-72e1c9a3-0f78-49dd-8018-c28b504b3b59" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "cinder-quobyte-72e1c9a3-0f78-49dd-8018-c28b504b3b59" released by "delete_volume" :: held 0.852s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:01 devstack cinder-volume[87095]: WARNING cinder.quota [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:02:01 devstack cinder-volume[87095]: WARNING cinder.quota [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Created reservations ['df712e8b-2302-47ce-8e1c-066c262a561c', 'e3217e1e-9c92-4d7a-8b88-b32153613db3', '28c683d6-0f14-4e8d-8954-c1edfad47b06', 'de695e53-fd78-46dc-8e7c-1ded41dba452'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:01 devstack sudo[98094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:01 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:02 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Deleted volume successfully.
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2c10e6ae-e98c-4878-952d-ae32147935e5 tempest-VolumeRetypeWithoutMigrationTest-1165641504 None] Lock "cinder-72e1c9a3-0f78-49dd-8018-c28b504b3b59-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Creating offline snapshot 4c80fb8a-065e-4226-be5d-2ba616b5e001 of volume 8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[33681ddc-11e3-426b-819f-5d7cb3de9b5d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:02 devstack sudo[98100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:02 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Flow 'volume_create_manager' (d9ae3a5a-512e-44b3-a79a-453f6b1a77a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe798702-d0bb-4592-8be0-71dd260a1802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe798702-d0bb-4592-8be0-71dd260a1802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1125570926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a18c755b85447009b2f744f63e1aab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:03Z,use_quota=True,user_id='d38f1e626e064c17b29d9a9f5a6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:03 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aeb79c-3424-449b-82a8-968e1a7b0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6aeb79c-3424-449b-82a8-968e1a7b0f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7391d912-d99f-4ba4-aaf0-d400b2c7e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7391d912-d99f-4ba4-aaf0-d400b2c7e81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11', 'volume_name': 'volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df713832-938c-4e3d-86d3-6fff24935489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df713832-938c-4e3d-86d3-6fff24935489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba1618a-9b8b-4318-8395-e31a548c7de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Volume 98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11', 'volume_size': 1}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 0.608s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:03 devstack sudo[98107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 1G
Sep 04 06:02:03 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:03 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 1G" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:03 devstack sudo[98113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:03 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:04 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:04 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 is being set with open permissions: ugo+rw
Sep 04 06:02:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:04 devstack sudo[98119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:04 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:04 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:04 devstack sudo[98131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info
Sep 04 06:02:04 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:05 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:05 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info is being set with open permissions: ugo+rw
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:05 devstack sudo[98140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info
Sep 04 06:02:05 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:05 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.info" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1125570926',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a18c755b85447009b2f744f63e1aab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:03Z,use_quota=True,user_id='d38f1e626e064c17b29d9a9f5a6b471e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Creating volume 98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:02:05 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=139,cinder:UPDATE=141,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:05 devstack sudo[98143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 1073741824
Sep 04 06:02:05 devstack sudo[98143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:DELETE=11,cinder:UPDATE=128,cinder:SELECT=117,cinder:INSERT=31 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a8f49be2-eebd-439a-aa78-1b41f1f25506 tempest-VolumesSnapshotTestJSON-56884914 None] Create snapshot completed successfully
Sep 04 06:02:05 devstack sudo[98143]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 1073741824" returned: 0 in 0.612s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:06 devstack sudo[98149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11
Sep 04 06:02:06 devstack sudo[98149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:06 devstack sudo[98149]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba1618a-9b8b-4318-8395-e31a548c7de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01d26f-7fac-426c-a58a-19d3afe7326e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Volume volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 (98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11): created successfully
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab01d26f-7fac-426c-a58a-19d3afe7326e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Flow 'volume_create_manager' (d9ae3a5a-512e-44b3-a79a-453f6b1a77a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9fbd1526-a38b-46cf-b1a3-64a3aa6caab0 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Created volume successfully.
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (cc089dc9-c2af-4e52-9501-e9922283d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11bf37d-bfeb-4979-8dca-333dff17a0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f11bf37d-bfeb-4979-8dca-333dff17a0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1347981655',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d0a3f8-eb83-45fb-a5b8-e9534e9de204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b21302a18644f35ada648f8ce977ab0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4c80fb8a-065e-4226-be5d-2ba616b5e001,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:07Z,use_quota=True,user_id='74f5f9a518b44f99b4935859b58d1856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87cb447-9b13-4189-87d5-1df90ac094a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87cb447-9b13-4189-87d5-1df90ac094a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3115a6-dc4c-4df6-9e4f-7f7856e8b184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f3115a6-dc4c-4df6-9e4f-7f7856e8b184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd7d0a3f8-eb83-45fb-a5b8-e9534e9de204', 'volume_name': 'volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204', 'volume_size': 1, 'snapshot_id': '4c80fb8a-065e-4226-be5d-2ba616b5e001'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a8be9a-16ed-4dc6-bf6d-f4b054699ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7a8be9a-16ed-4dc6-bf6d-f4b054699ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31adfd1-4d44-433d-b4b1-ed986a124eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Volume d7d0a3f8-eb83-45fb-a5b8-e9534e9de204: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204', 'volume_size': 1, 'snapshot_id': '4c80fb8a-065e-4226-be5d-2ba616b5e001'}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Creating volume d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 from snapshot 4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] snapshot: 4c80fb8a-065e-4226-be5d-2ba616b5e001, volume: d7d0a3f8-eb83-45fb-a5b8-e9534e9de204,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c43c3d2-4eb8-43d4-85f5-e70c13cb3551]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:07 devstack sudo[98153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:07 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:07 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:02:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[640d5a2c-08c3-40a8-b1b5-2593a034409c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:07 devstack sudo[98169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:07 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:08 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 1.030s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:02:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:08 devstack sudo[98226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204
Sep 04 06:02:08 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:12 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:12 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:13 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.741s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:02:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:02:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:02:15 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" returned: 0 in 6.854s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:02:15 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Converted 1024.00 MB image at 149.38 MB/s
Sep 04 06:02:15 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 is being set with open permissions: ugo+rw
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:15 devstack sudo[98253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204
Sep 04 06:02:15 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:15 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" released by "_copy_volume_from_snapshot" :: held 8.906s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" released by "_create_volume_from_snapshot" :: held 9.033s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.064s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.779s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Creating offline snapshot 36946903-1969-44d8-b432-7233490e0b02 of volume 98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31adfd1-4d44-433d-b4b1-ed986a124eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204', 'volume_size': 1, 'snapshot_id': '4c80fb8a-065e-4226-be5d-2ba616b5e001'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1fe08-776e-4835-afff-4feffbd1d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50391e20-904a-4261-9696-44f1c4b105dd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Volume volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 (d7d0a3f8-eb83-45fb-a5b8-e9534e9de204): created successfully
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1fe08-776e-4835-afff-4feffbd1d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Flow 'volume_create_manager' (cc089dc9-c2af-4e52-9501-e9922283d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c882fa98-01d1-480f-b3ba-96af7118789d tempest-VolumesSnapshotTestJSON-56884914 None] Created volume successfully.
Sep 04 06:02:16 devstack sudo[98264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11
Sep 04 06:02:16 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" acquired by "delete_volume" :: waited 0.052s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:16 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" returned: 0 in 0.670s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b0b705-bea9-4540-809c-686c68e266fe]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:16 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 1G
Sep 04 06:02:16 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:16 devstack sudo[98273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204
Sep 04 06:02:16 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:17 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" returned: 0 in 0.553s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:17 devstack sudo[98284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204
Sep 04 06:02:17 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:17 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 1G" returned: 0 in 0.817s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:17 devstack sudo[98286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02
Sep 04 06:02:17 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:17 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204" released by "delete_volume" :: held 1.095s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['a61719a9-faef-4197-94d2-7d6b01d24c87', '3e18ec2a-4603-4428-a8ba-9741e7cfb1ee', 'b61affa6-81dd-4039-a68e-2bee4a4086f9', '4ac2823e-02b1-430e-b2ca-e702692ddf14'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:17 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:17 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 is being set with open permissions: ugo+rw
Sep 04 06:02:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:17 devstack sudo[98292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:17 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:17 devstack sudo[98293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02
Sep 04 06:02:17 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-4c80fb8a-065e-4226-be5d-2ba616b5e001-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-4c80fb8a-065e-4226-be5d-2ba616b5e001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:18 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Deleting offline snapshot 4c80fb8a-065e-4226-be5d-2ba616b5e001 of volume 8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] snapshot_file for this snap is: volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:02:18 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca77911-ef8b-4567-999f-3527c0e975bd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Deleted volume successfully.
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b43bc27-5349-4674-91bd-44d3654ccd33 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-d7d0a3f8-eb83-45fb-a5b8-e9534e9de204-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:18 devstack sudo[98299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info
Sep 04 06:02:18 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:18 devstack sudo[98298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:18 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:18 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:18 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info is being set with open permissions: ugo+rw
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:18 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:02:18 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info
Sep 04 06:02:18 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d5bd86-736f-4284-b570-19d1cbed9108]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:18 devstack sudo[98309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:18 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:19 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.info" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.392s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fb004a1d-982e-4506-aee8-b66c52978ae7 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Create snapshot completed successfully
Sep 04 06:02:19 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 0.683s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:19 devstack sudo[98315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:19 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:19 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:19 devstack sudo[98320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001
Sep 04 06:02:19 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:20 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20.4c80fb8a-065e-4226-be5d-2ba616b5e001" returned: 0 in 0.395s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-4c80fb8a-065e-4226-be5d-2ba616b5e001" released by "_delete_snapshot" :: held 2.099s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" released by "delete_snapshot" :: held 2.151s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['131bd6a5-4e48-49d4-8030-c66e7598ed09', '35aa5715-641b-4774-9321-40d0a6867cfc', '61b4f457-6c66-4277-9315-e4b968f45bb6', '050a9d99-dbfa-4c97-98fb-b1ae471519f6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Delete snapshot completed successfully.
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d760748-6d1d-452f-a7c0-a7f99e35a948 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-4c80fb8a-065e-4226-be5d-2ba616b5e001-delete_snapshot" released by "delete_snapshot" :: held 2.407s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "cinder-36946903-1969-44d8-b432-7233490e0b02-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-36946903-1969-44d8-b432-7233490e0b02-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "cinder-quobyte-36946903-1969-44d8-b432-7233490e0b02" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-36946903-1969-44d8-b432-7233490e0b02" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Deleting offline snapshot 36946903-1969-44d8-b432-7233490e0b02 of volume 98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] snapshot_file for this snap is: volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b5ef65-4ec7-4b80-8091-455acc766ff6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:20 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02
Sep 04 06:02:20 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:21 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[047375c1-2637-4fff-8c7e-6514f609de7c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:21 devstack sudo[98329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11
Sep 04 06:02:21 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-8770a2b8-1f2d-41a4-983e-a57daddbfc20-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-8770a2b8-1f2d-41a4-983e-a57daddbfc20-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[072c4bd2-a0e3-439d-9856-ebd46e70e3ef]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:21 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:21 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02
Sep 04 06:02:21 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:21 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:21 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:22 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 0.545s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:22 devstack sudo[98344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20
Sep 04 06:02:22 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:22 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02" returned: 0 in 0.568s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:22 devstack sudo[98346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02
Sep 04 06:02:22 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:22 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-8770a2b8-1f2d-41a4-983e-a57daddbfc20" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-8770a2b8-1f2d-41a4-983e-a57daddbfc20" released by "delete_volume" :: held 1.024s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:22 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11.36946903-1969-44d8-b432-7233490e0b02" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-36946903-1969-44d8-b432-7233490e0b02" released by "_delete_snapshot" :: held 2.012s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" released by "delete_snapshot" :: held 2.044s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['bc442277-caea-4923-a052-ec54c22cb80b', 'bc4a6a34-d22a-4d06-b7c5-cbd54fbc260e', '684db9c2-72d6-4991-99ee-9ff09ee1a0f1', '74d397a0-bfb2-4054-a07c-3cb2903d9489'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Created reservations ['a7deaf69-bfa2-4b16-9cd2-fd6a72e17da5', '4dc45651-4f39-443c-a66a-5a9e1694dbcf', 'b90f68f9-627e-496b-a36f-25180a0c7aa9', '5c2ff40c-a6ea-485d-be75-70108ce21a35'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:22 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:22 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Delete snapshot completed successfully.
Sep 04 06:02:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7f995153-1cd9-4607-b288-7ef307eb9b32 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-36946903-1969-44d8-b432-7233490e0b02-delete_snapshot" released by "delete_snapshot" :: held 2.304s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:23 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Deleted volume successfully.
Sep 04 06:02:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f73cb5-dd17-47a8-aad1-386a3ab14e96 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-8770a2b8-1f2d-41a4-983e-a57daddbfc20-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-76b40041-76b1-400e-9fcd-3dca22b7891e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-76b40041-76b1-400e-9fcd-3dca22b7891e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "cinder-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1eac1e-839d-4267-b39f-9018ca04c479]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[676729b8-d0c4-4e34-a52f-56a0d5367813]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:24 devstack sudo[98375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e
Sep 04 06:02:24 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:24 devstack sudo[98376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11
Sep 04 06:02:24 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:24 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e" returned: 0 in 0.440s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:24 devstack sudo[98382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e
Sep 04 06:02:24 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:24 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:24 devstack sudo[98387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11
Sep 04 06:02:24 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:24 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-76b40041-76b1-400e-9fcd-3dca22b7891e" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-quobyte-76b40041-76b1-400e-9fcd-3dca22b7891e" released by "delete_volume" :: held 0.815s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Created reservations ['108e11fd-ce01-4940-838f-b3225ab56e84', 'c9a561d4-a76a-48bd-89fa-3d4108f5e488', 'da4ce1ca-2ece-4a53-82d1-98506fa84429', '8e76c80b-47b3-435e-aa17-cfba07a2cd5e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:25 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-quobyte-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11" released by "delete_volume" :: held 0.792s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Created reservations ['16b44753-651b-4468-8f46-6610964699e7', '5fc2bc45-78c3-4b7c-82ff-9263679901d9', 'cdc4f4cc-3d86-42bc-bb53-6ccc9c891261', '43fefbe3-7e12-4389-92a8-fd2999810675'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:25 devstack sudo[98391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:25 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:25 devstack sudo[98393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:25 devstack sudo[98393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:25 devstack sudo[98393]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Deleted volume successfully.
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3ebedcc3-7737-477b-b8ae-5d99221d2a11 tempest-VolumeSnapshotQuotasNegativeTestJSON-714957664 None] Lock "cinder-98a24eeb-2f2b-48c2-b57d-c95d5b2fdd11-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:25 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.510s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Deleted volume successfully.
Sep 04 06:02:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33d12be7-3313-4b68-aa71-ccb83ce5c807 tempest-VolumesSnapshotTestJSON-56884914 None] Lock "cinder-76b40041-76b1-400e-9fcd-3dca22b7891e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:DELETE=5,cinder:SELECT=40,cinder:UPDATE=50,cinder:INSERT=15 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:35 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=50,cinder:INSERT=12,cinder:SELECT=38,cinder:DELETE=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (f5e86b96-d7b8-4036-8483-c1546b0d39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe6689e-eeb3-4a7f-935c-ed10c860c8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffe6689e-eeb3-4a7f-935c-ed10c860c8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-430701924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e3e64e-737e-436d-8f2d-0ef3b7533fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:37Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f2f32-c4ef-4755-a82d-6aa44dc47308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c34f2f32-c4ef-4755-a82d-6aa44dc47308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4af0e8-d05f-4e46-ae61-bb29c71fbc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4af0e8-d05f-4e46-ae61-bb29c71fbc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e3e64e-737e-436d-8f2d-0ef3b7533fb2', 'volume_name': 'volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89062e-a181-4cd8-8059-857f32f58131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da89062e-a181-4cd8-8059-857f32f58131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7bf1be-df2a-424d-ac0f-d3f7034e2546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Volume d9e3e64e-737e-436d-8f2d-0ef3b7533fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2', 'volume_size': 1}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-430701924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e3e64e-737e-436d-8f2d-0ef3b7533fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f8aa1dd44e43228ab911801fd1c091',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:02:37Z,use_quota=True,user_id='6498f6e5fd394a2ca6ed32a8bfe02173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Creating volume d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:02:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:02:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:36 devstack sudo[98440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 1073741824
Sep 04 06:02:36 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:37 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 1073741824" returned: 0 in 0.608s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:37 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2
Sep 04 06:02:37 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:37 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be7bf1be-df2a-424d-ac0f-d3f7034e2546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6093f2-e37a-40c1-bbdc-365a99e99ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:02:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Volume volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 (d9e3e64e-737e-436d-8f2d-0ef3b7533fb2): created successfully
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6093f2-e37a-40c1-bbdc-365a99e99ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:02:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Flow 'volume_create_manager' (f5e86b96-d7b8-4036-8483-c1546b0d39b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:02:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cd2ffa71-f73b-49b6-97bf-0f9b51c507a6 tempest-AttachVolumeNegativeTest-522443171 None] Created volume successfully.
Sep 04 06:02:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-e7cf7549-f1cd-4eb7-952f-a065014c10bf req-a39e673d-c88e-4994-9ace-acf4dd19689d tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-e7cf7549-f1cd-4eb7-952f-a065014c10bf req-a39e673d-c88e-4994-9ace-acf4dd19689d tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-e7cf7549-f1cd-4eb7-952f-a065014c10bf req-a39e673d-c88e-4994-9ace-acf4dd19689d tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-e7cf7549-f1cd-4eb7-952f-a065014c10bf req-a39e673d-c88e-4994-9ace-acf4dd19689d tempest-AttachVolumeNegativeTest-522443171 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b61b3223-28fa-43ec-9722-11e1df17b188', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:02:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-e7cf7549-f1cd-4eb7-952f-a065014c10bf req-a39e673d-c88e-4994-9ace-acf4dd19689d tempest-AttachVolumeNegativeTest-522443171 None] attachment_update completed successfully.
Sep 04 06:02:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-32351e26-e298-48d8-8f61-7e424be92220 req-aa2170ca-9ff2-434d-968b-b17b76346f10 tempest-AttachVolumeNegativeTest-522443171 None] Terminate volume connection completed successfully.
Sep 04 06:02:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-32351e26-e298-48d8-8f61-7e424be92220 req-aa2170ca-9ff2-434d-968b-b17b76346f10 tempest-AttachVolumeNegativeTest-522443171 None] Deleting attachment b61b3223-28fa-43ec-9722-11e1df17b188. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:02:52 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=4,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:52 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=10,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:02:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-quobyte-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" acquired by "delete_volume" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b7616f-0a62-46cc-bc3b-af8c83a59dcd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:56 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2
Sep 04 06:02:56 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:56 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" returned: 0 in 0.548s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:56 devstack sudo[98924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2
Sep 04 06:02:56 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:56 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2" released by "delete_volume" :: held 0.903s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:56 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Created reservations ['dc5e2c7e-31ba-414b-9117-49940115f34d', 'd44a0aff-d2bd-47ac-94d0-b198f0e19900', 'b74aadf3-96bf-4bda-9528-200124b3f03b', 'fca35e99-f4f1-47df-8234-01e0d5343e2b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:57 devstack sudo[98927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:57 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:57 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Deleted volume successfully.
Sep 04 06:02:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-be34c75a-991c-45a3-83b1-4b3f256b33fe tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-d9e3e64e-737e-436d-8f2d-0ef3b7533fb2-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-742d5539-d8e6-48c4-aebf-b6bc5c997445-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-742d5539-d8e6-48c4-aebf-b6bc5c997445-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-quobyte-742d5539-d8e6-48c4-aebf-b6bc5c997445" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-742d5539-d8e6-48c4-aebf-b6bc5c997445" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c44e52-e4cd-4310-a971-9bfcbe26ad15]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:58 devstack sudo[98930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445
Sep 04 06:02:58 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:58 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:58 devstack sudo[98935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445
Sep 04 06:02:58 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:59 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-742d5539-d8e6-48c4-aebf-b6bc5c997445" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-742d5539-d8e6-48c4-aebf-b6bc5c997445" released by "delete_volume" :: held 0.946s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Created reservations ['3b4b46b3-e1c4-4f83-9bca-d50a1ba31fd2', 'db2c0f75-bcce-432c-ac86-4d96130efbe7', 'c1b46e58-71f3-4863-9a18-d25aa1b32212', '34a8242d-efcf-4823-9ea3-464aa4b5ba17'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:02:59 devstack sudo[98939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:02:59 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:02:59 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:02:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:02:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Deleted volume successfully.
Sep 04 06:03:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3816ca91-ba97-4301-b85e-e0dbe2c8c8cd tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-742d5539-d8e6-48c4-aebf-b6bc5c997445-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-6a9cddfb-5c4f-440e-abef-a8df72096d4a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-6a9cddfb-5c4f-440e-abef-a8df72096d4a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "cinder-quobyte-6a9cddfb-5c4f-440e-abef-a8df72096d4a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-6a9cddfb-5c4f-440e-abef-a8df72096d4a" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1594e548-1ab0-4655-a67d-f8e9ddcee1cc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:01 devstack sudo[99008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a
Sep 04 06:03:01 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:02 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a" returned: 0 in 0.713s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:02 devstack sudo[99016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a
Sep 04 06:03:02 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:02 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6a9cddfb-5c4f-440e-abef-a8df72096d4a" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-quobyte-6a9cddfb-5c4f-440e-abef-a8df72096d4a" released by "delete_volume" :: held 1.394s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Created reservations ['708fb4ec-97f3-483d-bee6-a829847e8494', '29ec044b-f8b3-49e4-8f0e-cb2466ff2fbd', '3a2bca77-dec3-4003-80cc-66060e26c993', 'bae93a82-87e4-4e0f-a75a-02e3963bf099'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:03 devstack sudo[99020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:03 devstack sudo[99020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:03 devstack sudo[99020]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.628s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:03 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Deleted volume successfully.
Sep 04 06:03:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6cac369d-7230-4f21-b2a7-ac641fdb4d4c tempest-AttachVolumeNegativeTest-522443171 None] Lock "cinder-6a9cddfb-5c4f-440e-abef-a8df72096d4a-delete_volume" released by "delete_volume" :: held 2.514s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (35470fe7-99c2-4345-8637-1a3905019cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba786c8-88e7-4e6e-a3c3-6ad79ab5d9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba786c8-88e7-4e6e-a3c3-6ad79ab5d9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778104502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d09c02-a235-4248-88e9-96c206787ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:07Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f594516-e891-448e-b731-26f4c0511f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f594516-e891-448e-b731-26f4c0511f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ed9701-da70-456e-946a-e21b946c1464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84ed9701-da70-456e-946a-e21b946c1464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d09c02-a235-4248-88e9-96c206787ad7', 'volume_name': 'volume-13d09c02-a235-4248-88e9-96c206787ad7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f56189-10ed-4144-9441-ac2ef2800fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f56189-10ed-4144-9441-ac2ef2800fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9372f1-ed80-4d40-ae05-ffe51206f87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Volume 13d09c02-a235-4248-88e9-96c206787ad7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d09c02-a235-4248-88e9-96c206787ad7', 'volume_size': 1}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778104502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d09c02-a235-4248-88e9-96c206787ad7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:07Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Creating volume 13d09c02-a235-4248-88e9-96c206787ad7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:06 devstack sudo[99024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 1073741824
Sep 04 06:03:06 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:07 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 1073741824" returned: 0 in 0.666s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:07 devstack sudo[99030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7
Sep 04 06:03:07 devstack sudo[99030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:07 devstack sudo[99030]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9372f1-ed80-4d40-ae05-ffe51206f87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d09c02-a235-4248-88e9-96c206787ad7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f4cb5-60a5-4642-b66f-e9ed50cfb93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Volume volume-13d09c02-a235-4248-88e9-96c206787ad7 (13d09c02-a235-4248-88e9-96c206787ad7): created successfully
Sep 04 06:03:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f4cb5-60a5-4642-b66f-e9ed50cfb93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (35470fe7-99c2-4345-8637-1a3905019cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3c7dad6c-f614-4ef4-b2d9-9169b5ef3567 tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-904e92b4-e147-4ec2-a197-01c1a4957a9c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-904e92b4-e147-4ec2-a197-01c1a4957a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7" acquired by "attach_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-904e92b4-e147-4ec2-a197-01c1a4957a9c tempest-VolumesActionsTest-1620923889 None] Attaching volume 13d09c02-a235-4248-88e9-96c206787ad7 to instance cf425fd9-2d6d-4278-9f06-23c441aadbe0 at mountpoint /dev/vdb on host None.
Sep 04 06:03:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-904e92b4-e147-4ec2-a197-01c1a4957a9c tempest-VolumesActionsTest-1620923889 None] Attach volume completed successfully.
Sep 04 06:03:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-904e92b4-e147-4ec2-a197-01c1a4957a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7" released by "attach_volume" :: held 0.155s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Terminate volume connection completed successfully.
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Detaching volume 13d09c02-a235-4248-88e9-96c206787ad7 from instance cf425fd9-2d6d-4278-9f06-23c441aadbe0.
Sep 04 06:03:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Detach volume completed successfully.
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cd7f7205-1a81-4405-a0d8-80938f1f31d0 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" released by "detach_volume" :: held 0.146s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4af8603c-a0cc-4b2f-9d9e-36cbebe641ea tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4af8603c-a0cc-4b2f-9d9e-36cbebe641ea tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4af8603c-a0cc-4b2f-9d9e-36cbebe641ea tempest-VolumesActionsTest-1620923889 None] Volume detach called, but volume not attached.
Sep 04 06:03:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4af8603c-a0cc-4b2f-9d9e-36cbebe641ea tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-quobyte-13d09c02-a235-4248-88e9-96c206787ad7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-quobyte-13d09c02-a235-4248-88e9-96c206787ad7" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85de8c38-2717-46a5-ae1a-c81ad98f57c7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:11 devstack sudo[99037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7
Sep 04 06:03:11 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:12 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7" returned: 0 in 0.743s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:12 devstack sudo[99045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7
Sep 04 06:03:12 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:12 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-13d09c02-a235-4248-88e9-96c206787ad7" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-quobyte-13d09c02-a235-4248-88e9-96c206787ad7" released by "delete_volume" :: held 1.420s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:12 devstack sudo[99048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:12 devstack sudo[99048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Created reservations ['c453f84c-dc93-4a9e-ad69-a94de9551d2c', 'c04d7ab6-2246-44a0-a0a3-01e1926c1237', '9f12c96e-77e8-4091-bb9b-d9aabfe5c866', '11e356ac-b447-464a-8752-9757923676bd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:13 devstack sudo[99051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:13 devstack sudo[99051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:13 devstack sudo[99048]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.956s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:03:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:03:14 devstack sudo[99051]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.832s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:14 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Deleted volume successfully.
Sep 04 06:03:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7985b255-e5f1-479e-be6c-17f445ac7a9c tempest-VolumesActionsTest-1620923889 None] Lock "cinder-13d09c02-a235-4248-88e9-96c206787ad7-delete_volume" released by "delete_volume" :: held 3.004s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Flow 'volume_create_manager' (87fcde56-c41e-4c67-aae5-36948126947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecfc127-451b-4161-87f6-7b8a05efb92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ecfc127-451b-4161-87f6-7b8a05efb92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-213111213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e78b486-2274-4e0b-bdd9-e80749717dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2591585d454171aff50f68d3a08b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:18Z,use_quota=True,user_id='8dbb085d33c4439581fffea67ba4103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1eb5dd-bc37-453e-b5e6-ddcb1a9bbb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1eb5dd-bc37-453e-b5e6-ddcb1a9bbb86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58138c68-2fbe-4501-ba1e-52e4de883965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58138c68-2fbe-4501-ba1e-52e4de883965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e78b486-2274-4e0b-bdd9-e80749717dea', 'volume_name': 'volume-1e78b486-2274-4e0b-bdd9-e80749717dea', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a95158-8577-4fcb-93e9-95f9a8b8ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a95158-8577-4fcb-93e9-95f9a8b8ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce90d3-1ef5-4726-809a-59f00f777944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Volume 1e78b486-2274-4e0b-bdd9-e80749717dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e78b486-2274-4e0b-bdd9-e80749717dea', 'volume_size': 1}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-213111213',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e78b486-2274-4e0b-bdd9-e80749717dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2591585d454171aff50f68d3a08b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:18Z,use_quota=True,user_id='8dbb085d33c4439581fffea67ba4103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Creating volume 1e78b486-2274-4e0b-bdd9-e80749717dea {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:18 devstack sudo[99080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea 1073741824
Sep 04 06:03:18 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (dd08913c-eea8-4657-b6d3-ddbe06f72d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37113b8-9d39-44df-b032-e1baaf3d2882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e37113b8-9d39-44df-b032-e1baaf3d2882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139606039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693da6cf-fe99-4d02-8a6c-0df8d476029f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:19Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31abe5c-a61c-4931-9d5d-485408134686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31abe5c-a61c-4931-9d5d-485408134686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f9ac8e-9b26-431e-8f48-0fbc3e2d5dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f9ac8e-9b26-431e-8f48-0fbc3e2d5dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '693da6cf-fe99-4d02-8a6c-0df8d476029f', 'volume_name': 'volume-693da6cf-fe99-4d02-8a6c-0df8d476029f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcc5d5e-d078-4fb9-87eb-c57cfe43febe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bcc5d5e-d078-4fb9-87eb-c57cfe43febe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbb72e4-70ee-44b8-9502-8a76d5abc845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Volume 693da6cf-fe99-4d02-8a6c-0df8d476029f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-693da6cf-fe99-4d02-8a6c-0df8d476029f', 'volume_size': 1}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:19 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea 1073741824" returned: 0 in 0.652s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:19 devstack sudo[99085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea
Sep 04 06:03:19 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:19 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.406s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2139606039',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=693da6cf-fe99-4d02-8a6c-0df8d476029f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:19Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Creating volume 693da6cf-fe99-4d02-8a6c-0df8d476029f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:19 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64ce90d3-1ef5-4726-809a-59f00f777944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e78b486-2274-4e0b-bdd9-e80749717dea', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027c94fa-be0b-4f98-a997-a5fd049e0197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:19 devstack sudo[99088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f 1073741824
Sep 04 06:03:19 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Volume volume-1e78b486-2274-4e0b-bdd9-e80749717dea (1e78b486-2274-4e0b-bdd9-e80749717dea): created successfully
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (027c94fa-be0b-4f98-a997-a5fd049e0197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Flow 'volume_create_manager' (87fcde56-c41e-4c67-aae5-36948126947b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9cde1b2e-c653-4a0b-a85b-aa8d0d921da2 tempest-VolumesTransfersTest-1424874496 None] Created volume successfully.
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Flow 'volume_create_manager' (e98defb9-1515-45ab-9a61-de6a08a3a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ee00a7-137a-4049-b284-c9504adecb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ee00a7-137a-4049-b284-c9504adecb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-527494819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f8400c-9730-4c98-b617-fa159530ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27260ada79594f54873be98d4e6f28a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:20Z,use_quota=True,user_id='a285b595708d411e9c27d5cef7d1c07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a2cee0-c04b-42ec-9606-3bd80b4b7618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a2cee0-c04b-42ec-9606-3bd80b4b7618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567d84e2-dd7e-4736-b940-0ac6c05a1e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567d84e2-dd7e-4736-b940-0ac6c05a1e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15f8400c-9730-4c98-b617-fa159530ef71', 'volume_name': 'volume-15f8400c-9730-4c98-b617-fa159530ef71', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa4cb44-dc1c-4f31-a80f-7027c3a7a76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2aa4cb44-dc1c-4f31-a80f-7027c3a7a76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c838c0-ca22-4bf7-9557-7711688a1a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Volume 15f8400c-9730-4c98-b617-fa159530ef71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15f8400c-9730-4c98-b617-fa159530ef71', 'volume_size': 1}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:20 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f 1073741824" returned: 0 in 0.609s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:20 devstack sudo[99093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f
Sep 04 06:03:20 devstack sudo[99093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:20 devstack sudo[99093]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-527494819',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15f8400c-9730-4c98-b617-fa159530ef71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27260ada79594f54873be98d4e6f28a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:20Z,use_quota=True,user_id='a285b595708d411e9c27d5cef7d1c07c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Creating volume 15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:20 devstack sudo[99097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 1073741824
Sep 04 06:03:20 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfbb72e4-70ee-44b8-9502-8a76d5abc845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-693da6cf-fe99-4d02-8a6c-0df8d476029f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e2c3a4-8425-4f4b-8639-516cbcc1a685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Volume volume-693da6cf-fe99-4d02-8a6c-0df8d476029f (693da6cf-fe99-4d02-8a6c-0df8d476029f): created successfully
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e2c3a4-8425-4f4b-8639-516cbcc1a685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (dd08913c-eea8-4657-b6d3-ddbe06f72d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7aeb97b4-47bf-4816-a740-1a6f818b24d0 tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:21 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 1073741824" returned: 0 in 0.659s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-693da6cf-fe99-4d02-8a6c-0df8d476029f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:21 devstack sudo[99103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71
Sep 04 06:03:21 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-693da6cf-fe99-4d02-8a6c-0df8d476029f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-quobyte-693da6cf-fe99-4d02-8a6c-0df8d476029f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-693da6cf-fe99-4d02-8a6c-0df8d476029f" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5d72575e-ee92-4a90-9896-a90e646d00d4 tempest-VolumesTransfersTest-1515376029 None] Transfer volume completed successfully.
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d1987-2735-4797-a02e-a4b197ea87d8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:21 devstack sudo[99105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f
Sep 04 06:03:21 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:21 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c838c0-ca22-4bf7-9557-7711688a1a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15f8400c-9730-4c98-b617-fa159530ef71', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333ffd1-2b73-4a38-a1a2-fc35c6a14664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Volume volume-15f8400c-9730-4c98-b617-fa159530ef71 (15f8400c-9730-4c98-b617-fa159530ef71): created successfully
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d333ffd1-2b73-4a38-a1a2-fc35c6a14664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Flow 'volume_create_manager' (e98defb9-1515-45ab-9a61-de6a08a3a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-09bbb628-d49d-4a55-ac72-2b1a58307955 req-3cb563c9-708e-4d71-9402-6a11e1e8f531 tempest-VolumesSnapshotsTestJSON-1781051842 None] Created volume successfully.
Sep 04 06:03:22 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f" returned: 0 in 0.535s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:22 devstack sudo[99114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f
Sep 04 06:03:22 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:22 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "cinder-1e78b486-2274-4e0b-bdd9-e80749717dea-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-693da6cf-fe99-4d02-8a6c-0df8d476029f" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-693da6cf-fe99-4d02-8a6c-0df8d476029f" released by "delete_volume" :: held 0.955s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-1e78b486-2274-4e0b-bdd9-e80749717dea-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "cinder-quobyte-1e78b486-2274-4e0b-bdd9-e80749717dea" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-quobyte-1e78b486-2274-4e0b-bdd9-e80749717dea" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cba21d-7e12-44ec-b951-ccb90b70816d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Created reservations ['4f3d1407-8df8-4c14-914a-22c032d861de', 'de0405a0-f5da-43e1-bd89-1aa89d05a37f', '2db44f21-c0c6-4fed-a86b-a670e2158aa5', 'a4793f6b-ea4d-49b6-b652-6133543f0075'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Creating offline snapshot c90d202d-f02c-4cf7-abbc-a260dbab8702 of volume 15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5262ed31-d323-4d9b-884a-02dcc6e9c5c7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:22 devstack sudo[99119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:22 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:22 devstack sudo[99117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea
Sep 04 06:03:22 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:23 devstack sudo[99118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71
Sep 04 06:03:23 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:23 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Deleted volume successfully.
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5c7d2f8e-8214-43d2-989e-ee334d58dbe3 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-693da6cf-fe99-4d02-8a6c-0df8d476029f-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:23 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea" returned: 0 in 0.603s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:23 devstack sudo[99130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea
Sep 04 06:03:23 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:23 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71" returned: 0 in 0.594s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:23 devstack sudo[99133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 1G
Sep 04 06:03:23 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:23 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e78b486-2274-4e0b-bdd9-e80749717dea" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-quobyte-1e78b486-2274-4e0b-bdd9-e80749717dea" released by "delete_volume" :: held 1.019s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Created reservations ['283c7708-c116-47ea-a479-95f0043ef1c3', 'b5b38178-e3a5-45fb-ba17-3b0832b1ea46', 'b1f2b9b2-208f-4131-9532-f91c0a19fb07', '8be20fe2-0f67-4835-96d6-56c3d840a527'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:24 devstack sudo[99139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:24 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:24 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 1G" returned: 0 in 0.780s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f8400c-9730-4c98-b617-fa159530ef71 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:24 devstack sudo[99141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f8400c-9730-4c98-b617-fa159530ef71 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702
Sep 04 06:03:24 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:24 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Deleted volume successfully.
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d96e7f7-b7d2-430e-9171-dd132f3b4477 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-1e78b486-2274-4e0b-bdd9-e80749717dea-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:24 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15f8400c-9730-4c98-b617-fa159530ef71 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702" returned: 0 in 0.562s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 is being set with open permissions: ugo+rw
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:24 devstack sudo[99147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702
Sep 04 06:03:24 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (853517e2-c43f-48e4-b057-6ac0268c9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62729b67-6baf-484a-9bd3-1e1d54410a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62729b67-6baf-484a-9bd3-1e1d54410a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844221033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e42e1-778b-4e76-97c9-bb846f72cf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:25Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0503b4-2086-4865-bcb7-f59241433d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0503b4-2086-4865-bcb7-f59241433d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7c4ee4-5028-421d-927d-0b7b27274201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7c4ee4-5028-421d-927d-0b7b27274201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51e42e1-778b-4e76-97c9-bb846f72cf95', 'volume_name': 'volume-f51e42e1-778b-4e76-97c9-bb846f72cf95', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d92942-f41e-45aa-9396-c9f3997fc6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02d92942-f41e-45aa-9396-c9f3997fc6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bd5db5-1cdb-436e-8914-2a742cf3d592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Volume f51e42e1-778b-4e76-97c9-bb846f72cf95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51e42e1-778b-4e76-97c9-bb846f72cf95', 'volume_size': 1}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:25 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:25 devstack sudo[99151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info
Sep 04 06:03:25 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:25 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:25 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info is being set with open permissions: ugo+rw
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:25 devstack sudo[99165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info
Sep 04 06:03:25 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Flow 'volume_create_manager' (68430b60-5c6c-4e49-9351-c6de9ce5db4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d004d2-cd15-4bfd-a0da-965d65bab71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d004d2-cd15-4bfd-a0da-965d65bab71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1986604137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acf6d40-60f1-445d-8eea-3907dc1be4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2591585d454171aff50f68d3a08b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:26Z,use_quota=True,user_id='8dbb085d33c4439581fffea67ba4103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715e997d-aace-4444-ac66-121faaa5960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715e997d-aace-4444-ac66-121faaa5960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ce7c52-dcd7-4104-aed3-89f99af380d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ce7c52-dcd7-4104-aed3-89f99af380d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acf6d40-60f1-445d-8eea-3907dc1be4cd', 'volume_name': 'volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512a1454-fa79-4c0c-980f-812a61cc5ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512a1454-fa79-4c0c-980f-812a61cc5ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18182f92-d311-4c29-8bd7-b4984960bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Volume 6acf6d40-60f1-445d-8eea-3907dc1be4cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd', 'volume_size': 1}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:25 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.info" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.259s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-844221033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51e42e1-778b-4e76-97c9-bb846f72cf95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:25Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Creating volume f51e42e1-778b-4e76-97c9-bb846f72cf95 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:26 devstack sudo[99174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 1073741824
Sep 04 06:03:26 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-1bd5687e-ec6e-40cd-83c0-36926a9d0c05 req-381e7b47-76df-42fc-bf95-a0f80be84cd0 tempest-VolumesSnapshotsTestJSON-1781051842 None] Create snapshot completed successfully
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "cinder-c90d202d-f02c-4cf7-abbc-a260dbab8702-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-c90d202d-f02c-4cf7-abbc-a260dbab8702-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "cinder-quobyte-c90d202d-f02c-4cf7-abbc-a260dbab8702" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-c90d202d-f02c-4cf7-abbc-a260dbab8702" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Deleting offline snapshot c90d202d-f02c-4cf7-abbc-a260dbab8702 of volume 15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] snapshot_file for this snap is: volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97177c25-68e5-4619-91b4-bd869d88844d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:26 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 1073741824" returned: 0 in 0.666s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:26 devstack sudo[99191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702
Sep 04 06:03:26 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:26 devstack sudo[99195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95
Sep 04 06:03:26 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:27 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95" returned: 0 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1986604137',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acf6d40-60f1-445d-8eea-3907dc1be4cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df2591585d454171aff50f68d3a08b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:26Z,use_quota=True,user_id='8dbb085d33c4439581fffea67ba4103f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Creating volume 6acf6d40-60f1-445d-8eea-3907dc1be4cd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:27 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702" returned: 0 in 0.511s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15f8400c-9730-4c98-b617-fa159530ef71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:03:27 devstack sudo[99203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd 1073741824
Sep 04 06:03:27 devstack sudo[99203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bd5db5-1cdb-436e-8914-2a742cf3d592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51e42e1-778b-4e76-97c9-bb846f72cf95', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8154cab0-2aa2-4f08-a515-361d46dee763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bc99ef-0ec1-4221-bac7-eea058640d9f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Volume volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 (f51e42e1-778b-4e76-97c9-bb846f72cf95): created successfully
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8154cab0-2aa2-4f08-a515-361d46dee763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (853517e2-c43f-48e4-b057-6ac0268c9d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-62aef8e0-405f-4b19-b8ae-17b338bb961e tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:27 devstack sudo[99205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71
Sep 04 06:03:27 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:27 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71" returned: 0 in 0.562s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:27 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702
Sep 04 06:03:27 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:27 devstack sudo[99203]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd 1073741824" returned: 0 in 0.753s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:28 devstack sudo[99247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd
Sep 04 06:03:28 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:28 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-f51e42e1-778b-4e76-97c9-bb846f72cf95-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702" returned: 0 in 0.820s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:28 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:28 devstack sudo[99278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702
Sep 04 06:03:28 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "cinder-f51e42e1-778b-4e76-97c9-bb846f72cf95-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd" returned: 0 in 0.735s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] <== create_volume: return (1596ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18182f92-d311-4c29-8bd7-b4984960bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ea39e9-f2fd-4082-978b-938ae9dbaf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Volume volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd (6acf6d40-60f1-445d-8eea-3907dc1be4cd): created successfully
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16ea39e9-f2fd-4082-978b-938ae9dbaf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Flow 'volume_create_manager' (68430b60-5c6c-4e49-9351-c6de9ce5db4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-quobyte-f51e42e1-778b-4e76-97c9-bb846f72cf95" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7d3c7a1e-8990-40ee-bd5a-48c350e2bf10 tempest-VolumesTransfersTest-1424874496 None] Created volume successfully.
Sep 04 06:03:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-f51e42e1-778b-4e76-97c9-bb846f72cf95" acquired by "delete_volume" :: waited 0.072s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1335e0-e89f-4704-987e-4b13e5da0e66]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:29 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71.c90d202d-f02c-4cf7-abbc-a260dbab8702" returned: 0 in 0.627s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:29 devstack sudo[99287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95
Sep 04 06:03:29 devstack sudo[99287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-c90d202d-f02c-4cf7-abbc-a260dbab8702" released by "_delete_snapshot" :: held 2.782s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" released by "delete_snapshot" :: held 2.839s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.quota [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Created reservations ['12a18f98-602f-497d-a2ff-f644fac1c3df', '832ddf46-2b8b-4690-a86b-7a1d12f5227e', '393466db-0ac2-4407-a841-8fc8c947b56c', '9f61ec7b-9652-475b-b98f-5f6c8eab52f1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Delete snapshot completed successfully.
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-547145b3-46c2-4b79-8501-8adaeaa06adb req-ab4d56f7-f657-4e85-b47a-0ddf917dd2be tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-c90d202d-f02c-4cf7-abbc-a260dbab8702-delete_snapshot" released by "delete_snapshot" :: held 3.095s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:29 devstack sudo[99287]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95" returned: 0 in 0.621s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:29 devstack sudo[99296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95
Sep 04 06:03:29 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "cinder-6acf6d40-60f1-445d-8eea-3907dc1be4cd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-6acf6d40-60f1-445d-8eea-3907dc1be4cd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "cinder-quobyte-6acf6d40-60f1-445d-8eea-3907dc1be4cd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-quobyte-6acf6d40-60f1-445d-8eea-3907dc1be4cd" acquired by "delete_volume" :: waited 0.067s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "cinder-15f8400c-9730-4c98-b617-fa159530ef71-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1101b37-a50b-4990-8df2-83d7dd09f6f5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-15f8400c-9730-4c98-b617-fa159530ef71-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" acquired by "delete_volume" :: waited 0.042s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:30 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:30 devstack sudo[99334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd
Sep 04 06:03:30 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f51e42e1-778b-4e76-97c9-bb846f72cf95" returned: 0 in 0.911s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd01f1-226d-4f65-9bdc-f21efb58c775]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-f51e42e1-778b-4e76-97c9-bb846f72cf95" released by "delete_volume" :: held 1.674s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Created reservations ['9d663687-2c6e-4fbd-9975-cd9430507602', '93a4f985-921b-4f80-98c2-cbb8e774ced3', '72f19912-f91e-4212-b552-eed31fcb7866', 'b1c89e15-1c7d-48c3-84a0-00190709b8b4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:30 devstack sudo[99338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71
Sep 04 06:03:30 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:30 devstack sudo[99343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:30 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:31 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd" returned: 0 in 0.870s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:31 devstack sudo[99348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd
Sep 04 06:03:31 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:31 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71" returned: 0 in 0.870s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:31 devstack sudo[99353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71
Sep 04 06:03:31 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:31 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.883s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:31 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Deleted volume successfully.
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6acf6d40-60f1-445d-8eea-3907dc1be4cd" returned: 0 in 0.766s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-quobyte-6acf6d40-60f1-445d-8eea-3907dc1be4cd" released by "delete_volume" :: held 1.813s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-69a019bc-7d0a-4608-b443-07ed6c1bdf5f tempest-VolumesActionsTest-1370392704 None] Lock "cinder-f51e42e1-778b-4e76-97c9-bb846f72cf95-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Created reservations ['13eb69d6-7710-4f13-abdc-c37a937dc287', 'af4320e8-9151-4244-9e43-fb731345f77d', '37e8f1f8-5e86-4a3c-9e5f-493a3a4ad0d9', 'f53be49c-2d6f-4993-a25e-e51d71cd0c97'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:32 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-15f8400c-9730-4c98-b617-fa159530ef71" returned: 0 in 0.708s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-quobyte-15f8400c-9730-4c98-b617-fa159530ef71" released by "delete_volume" :: held 1.760s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:32 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:32 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (5d64cd94-f988-4586-9e76-89782878c887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a2d086-d652-4064-8430-e334f9158088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a2d086-d652-4064-8430-e334f9158088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100486287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e324b0-c163-49c8-8467-632875d87223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:32Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9cc83f-a293-49da-94ec-d4ef74ed4579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9cc83f-a293-49da-94ec-d4ef74ed4579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957d3b8-fd78-40da-a4b5-50b1282ceb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f957d3b8-fd78-40da-a4b5-50b1282ceb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e324b0-c163-49c8-8467-632875d87223', 'volume_name': 'volume-30e324b0-c163-49c8-8467-632875d87223', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b731bf6-5d2e-4b1c-8162-c9160fae0c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b731bf6-5d2e-4b1c-8162-c9160fae0c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f7304-0d25-467d-baca-d8c8cd576b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Volume 30e324b0-c163-49c8-8467-632875d87223: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e324b0-c163-49c8-8467-632875d87223', 'volume_size': 1}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2100486287',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e324b0-c163-49c8-8467-632875d87223,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:32Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Creating volume 30e324b0-c163-49c8-8467-632875d87223 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:32 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.quota [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Created reservations ['3f7e0219-825b-4589-b270-cddcebfba6d1', 'ba179cf7-a185-4de8-8cfb-9cb38cbb25b0', '243c3946-60e8-419f-b85c-877b84484607', 'fb2da3ce-bb64-423c-ae4a-7740dac82638'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:32 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 1073741824
Sep 04 06:03:32 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:32 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.590s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Deleted volume successfully.
Sep 04 06:03:32 devstack sudo[99363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:32 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c0f1cd67-af7d-47a6-a2c3-d35b6d56ddb0 tempest-VolumesTransfersTest-1331037824 None] Lock "cinder-6acf6d40-60f1-445d-8eea-3907dc1be4cd-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:33 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.649s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:33 devstack cinder-volume[87095]: DEBUG cinder.manager [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Deleted volume successfully.
Sep 04 06:03:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-5bbe2761-9374-49da-903e-96b4a67354c5 req-520d2c5d-2fa9-434d-a316-d228fe213c0c tempest-VolumesSnapshotsTestJSON-1781051842 None] Lock "cinder-15f8400c-9730-4c98-b617-fa159530ef71-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:33 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 1073741824" returned: 0 in 1.163s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:33 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223
Sep 04 06:03:33 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Flow 'volume_create_manager' (373c2cc5-4f75-49cc-afe1-283df6bc2e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2560493a-7f79-4ee7-a288-e3a825c0aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2560493a-7f79-4ee7-a288-e3a825c0aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1441484815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4a194-c7e6-4603-94be-b3b82a3a6e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89e67a867e4439a97ce989f5c20518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:34Z,use_quota=True,user_id='fbe4dcd6f3364a9abcb8ddbd05d546c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3599550c-539a-4503-9b4d-d0a4ea868466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3599550c-539a-4503-9b4d-d0a4ea868466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d721602b-1325-40e5-aa28-015fe69b3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d721602b-1325-40e5-aa28-015fe69b3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2da4a194-c7e6-4603-94be-b3b82a3a6e5f', 'volume_name': 'volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19be2cd9-4759-4de1-b738-c0e394bc1161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19be2cd9-4759-4de1-b738-c0e394bc1161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6cfaef-c9e6-40da-b79a-8c87087d7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Volume 2da4a194-c7e6-4603-94be-b3b82a3a6e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f', 'volume_size': 1}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:34 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223" returned: 0 in 0.651s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1441484815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2da4a194-c7e6-4603-94be-b3b82a3a6e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89e67a867e4439a97ce989f5c20518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:34Z,use_quota=True,user_id='fbe4dcd6f3364a9abcb8ddbd05d546c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Creating volume 2da4a194-c7e6-4603-94be-b3b82a3a6e5f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:34 devstack sudo[99373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f 1073741824
Sep 04 06:03:34 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c6f7304-0d25-467d-baca-d8c8cd576b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e324b0-c163-49c8-8467-632875d87223', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745acd98-1d3e-45cb-b18a-1c0938602fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Volume volume-30e324b0-c163-49c8-8467-632875d87223 (30e324b0-c163-49c8-8467-632875d87223): created successfully
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745acd98-1d3e-45cb-b18a-1c0938602fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (5d64cd94-f988-4586-9e76-89782878c887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c8827dd4-c472-4d67-85c2-5c5602ea1c0c tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:35 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f 1073741824" returned: 0 in 0.718s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:35 devstack sudo[99379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f
Sep 04 06:03:35 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:35 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" returned: 0 in 0.600s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-30e324b0-c163-49c8-8467-632875d87223-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6cfaef-c9e6-40da-b79a-8c87087d7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ef6474-c030-4b57-8230-1cdb0d6dfc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Volume volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f (2da4a194-c7e6-4603-94be-b3b82a3a6e5f): created successfully
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8ef6474-c030-4b57-8230-1cdb0d6dfc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Flow 'volume_create_manager' (373c2cc5-4f75-49cc-afe1-283df6bc2e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "cinder-30e324b0-c163-49c8-8467-632875d87223-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-340bbebb-fe94-4c7f-8a87-4d8257c372bc tempest-TestMinimumBasicScenario-359047127 None] Created volume successfully.
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-quobyte-30e324b0-c163-49c8-8467-632875d87223" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-30e324b0-c163-49c8-8467-632875d87223" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e803cb02-b803-45eb-8d73-badd55bc6506]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:36 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223
Sep 04 06:03:36 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:37 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223" returned: 0 in 1.027s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:37 devstack sudo[99391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223
Sep 04 06:03:37 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d1dfd722-0562-4b49-8e61-f695501fb3f2 req-6d6f8447-0cbf-487e-94a7-b957267c5787 tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d1dfd722-0562-4b49-8e61-f695501fb3f2 req-6d6f8447-0cbf-487e-94a7-b957267c5787 tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-d1dfd722-0562-4b49-8e61-f695501fb3f2 req-6d6f8447-0cbf-487e-94a7-b957267c5787 tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-d1dfd722-0562-4b49-8e61-f695501fb3f2 req-6d6f8447-0cbf-487e-94a7-b957267c5787 tempest-TestMinimumBasicScenario-359047127 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8504d44-a873-4fb9-b5d0-e9113f29df3b', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:03:37 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30e324b0-c163-49c8-8467-632875d87223" returned: 0 in 0.668s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-30e324b0-c163-49c8-8467-632875d87223" released by "delete_volume" :: held 1.797s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-d1dfd722-0562-4b49-8e61-f695501fb3f2 req-6d6f8447-0cbf-487e-94a7-b957267c5787 tempest-TestMinimumBasicScenario-359047127 None] attachment_update completed successfully.
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Created reservations ['201a5727-83b6-471b-be58-ca1531f0611d', '889530d8-daed-4137-9c54-bfcf61e2b05d', 'f6be9f41-d696-410d-9533-aa71baa5af18', '204ed5f1-b499-42be-b642-4fa91c2cfb72'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:38 devstack sudo[99424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:38 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:38 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Deleted volume successfully.
Sep 04 06:03:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f15e55cf-b620-48b6-9b7a-f3a1c8b4746c tempest-VolumesActionsTest-1370392704 None] Lock "cinder-30e324b0-c163-49c8-8467-632875d87223-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (24f3f3b7-591f-4060-9630-eaa62018bda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54942c05-8b4e-4ce2-b00a-a05d4fff4836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54942c05-8b4e-4ce2-b00a-a05d4fff4836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755462187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3e05ca-3782-4c5a-81af-a349e5a341dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:40Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67c5ed4-db9f-4f99-ace9-34f36a081dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c67c5ed4-db9f-4f99-ace9-34f36a081dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475da0a9-e068-4e61-a41a-aa2b16a147bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (475da0a9-e068-4e61-a41a-aa2b16a147bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df3e05ca-3782-4c5a-81af-a349e5a341dd', 'volume_name': 'volume-df3e05ca-3782-4c5a-81af-a349e5a341dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50283b7c-fdbc-4bab-be6c-7f148344254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50283b7c-fdbc-4bab-be6c-7f148344254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3029144-d121-4793-8ad5-961be29711c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Volume df3e05ca-3782-4c5a-81af-a349e5a341dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df3e05ca-3782-4c5a-81af-a349e5a341dd', 'volume_size': 1}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1755462187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df3e05ca-3782-4c5a-81af-a349e5a341dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:40Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Creating volume df3e05ca-3782-4c5a-81af-a349e5a341dd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:40 devstack sudo[99789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd 1073741824
Sep 04 06:03:40 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:40 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd 1073741824" returned: 0 in 0.882s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:41 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd
Sep 04 06:03:41 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:41 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3029144-d121-4793-8ad5-961be29711c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df3e05ca-3782-4c5a-81af-a349e5a341dd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53678d9-6823-4f5a-80e9-134f6b2b5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Volume volume-df3e05ca-3782-4c5a-81af-a349e5a341dd (df3e05ca-3782-4c5a-81af-a349e5a341dd): created successfully
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b53678d9-6823-4f5a-80e9-134f6b2b5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (24f3f3b7-591f-4060-9630-eaa62018bda7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8af59c24-6bd1-4868-b75e-8d99e4f443e7 tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Flow 'volume_create_manager' (db94bdc3-f8f4-4acc-9cd2-64390667ab40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e38b8ba-6d89-4623-9c73-0dcc2bafe9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e38b8ba-6d89-4623-9c73-0dcc2bafe9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-339415777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ebaecb-33f0-46dc-8928-cf4126b4bbac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d5c2db8c5f44acc8adcbb724f8ef04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:42Z,use_quota=True,user_id='42309c7609194af2b604482c4b3a44fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb85429e-d2a0-4c15-a3a0-730c0addd549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb85429e-d2a0-4c15-a3a0-730c0addd549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb67063-8016-4b98-aa0c-c9a2fb6a208b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cb67063-8016-4b98-aa0c-c9a2fb6a208b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ebaecb-33f0-46dc-8928-cf4126b4bbac', 'volume_name': 'volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86ec952-de76-4077-9309-b13248e0d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c86ec952-de76-4077-9309-b13248e0d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89205909-449b-44f3-b0ca-918641f52715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Volume e7ebaecb-33f0-46dc-8928-cf4126b4bbac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac', 'volume_size': 1}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-339415777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ebaecb-33f0-46dc-8928-cf4126b4bbac,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8d5c2db8c5f44acc8adcbb724f8ef04b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:42Z,use_quota=True,user_id='42309c7609194af2b604482c4b3a44fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Creating volume e7ebaecb-33f0-46dc-8928-cf4126b4bbac {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:42 devstack sudo[99798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac 1073741824
Sep 04 06:03:42 devstack sudo[99798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-df3e05ca-3782-4c5a-81af-a349e5a341dd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-df3e05ca-3782-4c5a-81af-a349e5a341dd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "cinder-quobyte-df3e05ca-3782-4c5a-81af-a349e5a341dd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-df3e05ca-3782-4c5a-81af-a349e5a341dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[521e39e9-d657-4e38-9c3f-065435c4c190]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:42 devstack sudo[99800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd
Sep 04 06:03:42 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:43 devstack sudo[99798]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac 1073741824" returned: 0 in 0.904s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:43 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd" returned: 0 in 0.669s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:43 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac
Sep 04 06:03:43 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:43 devstack sudo[99811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd
Sep 04 06:03:43 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:43 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-df3e05ca-3782-4c5a-81af-a349e5a341dd" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-quobyte-df3e05ca-3782-4c5a-81af-a349e5a341dd" released by "delete_volume" :: held 1.183s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:43 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" returned: 0 in 0.529s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.529s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89205909-449b-44f3-b0ca-918641f52715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c32fbf-6235-4080-9a35-84016df1f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Volume volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac (e7ebaecb-33f0-46dc-8928-cf4126b4bbac): created successfully
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c32fbf-6235-4080-9a35-84016df1f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Flow 'volume_create_manager' (db94bdc3-f8f4-4acc-9cd2-64390667ab40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-42613b58-7e2d-4cf6-8d88-91cc5c6c5889 req-692b11bf-af98-4088-ade4-062000ad338a tempest-VolumesGetTestJSON-717519964 None] Created volume successfully.
Sep 04 06:03:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Created reservations ['f46cfa2c-5620-4702-a1e7-7e0c67cedb0d', 'aa3ea103-b875-4372-ac28-8512ad677f02', '8ae98ecf-4d80-44ee-85dc-0a87d50935e2', 'b3f743eb-4636-44ce-a4e2-51c113718a27'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:44 devstack sudo[99840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:44 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:44 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Deleted volume successfully.
Sep 04 06:03:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-67735bfc-6888-4ba2-a3b6-7aadc509b726 tempest-VolumesActionsTest-1370392704 None] Lock "cinder-df3e05ca-3782-4c5a-81af-a349e5a341dd-delete_volume" released by "delete_volume" :: held 2.110s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Acquiring lock "cinder-e7ebaecb-33f0-46dc-8928-cf4126b4bbac-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "cinder-e7ebaecb-33f0-46dc-8928-cf4126b4bbac-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Acquiring lock "cinder-quobyte-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "cinder-quobyte-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4423d01-034b-4fcd-a09a-9ae86301f6dc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:45 devstack sudo[99846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac
Sep 04 06:03:45 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (d448437f-a30e-4c43-b923-d792c84dc2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da609fe-d042-4279-a7b5-765d120833ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5da609fe-d042-4279-a7b5-765d120833ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-158152811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baf2af8-fb21-40d0-b51d-3b47e49d4173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:46Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33df752b-03d3-4477-9191-a660551b8fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33df752b-03d3-4477-9191-a660551b8fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f1489b-5d27-4d68-98ba-1c5941e5a085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f1489b-5d27-4d68-98ba-1c5941e5a085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4baf2af8-fb21-40d0-b51d-3b47e49d4173', 'volume_name': 'volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53740068-66ef-4253-aa3f-8bae66c7c75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53740068-66ef-4253-aa3f-8bae66c7c75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960cf63-a4d9-4450-8fcb-8d5034c35a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Volume 4baf2af8-fb21-40d0-b51d-3b47e49d4173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173', 'volume_size': 1}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-158152811',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4baf2af8-fb21-40d0-b51d-3b47e49d4173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe852eaaf79e47499443b439a9913bc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:46Z,use_quota=True,user_id='1ce4e9a74331404daaab85ac5cf2d62e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Creating volume 4baf2af8-fb21-40d0-b51d-3b47e49d4173 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:45 devstack sudo[99851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 1073741824
Sep 04 06:03:45 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:45 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" returned: 0 in 0.632s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:45 devstack sudo[99853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac
Sep 04 06:03:45 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:46 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "cinder-quobyte-e7ebaecb-33f0-46dc-8928-cf4126b4bbac" released by "delete_volume" :: held 1.179s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG cinder.quota [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Created reservations ['bc7f909b-a9fb-4af0-8607-a65602780f31', '2ee46fc7-f445-4926-85aa-25be733478b6', 'c9a2d9dd-29e2-43e9-840d-e29475a83463', '651007eb-84e5-4602-aaed-94a11966ac8b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:46 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 1073741824" returned: 0 in 0.816s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:46 devstack sudo[99860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:46 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:46 devstack sudo[99862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173
Sep 04 06:03:46 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:47 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.manager [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Deleted volume successfully.
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-830df3f9-b0ab-449b-9051-fe3adb236e52 req-af7ed8ef-ac66-4248-9a6f-0b102f6ed35a tempest-VolumesGetTestJSON-717519964 None] Lock "cinder-e7ebaecb-33f0-46dc-8928-cf4126b4bbac-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:47 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b960cf63-a4d9-4450-8fcb-8d5034c35a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae13f158-26c1-4dfd-9322-2618a3543bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Volume volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 (4baf2af8-fb21-40d0-b51d-3b47e49d4173): created successfully
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae13f158-26c1-4dfd-9322-2618a3543bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Flow 'volume_create_manager' (d448437f-a30e-4c43-b923-d792c84dc2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2b2cf258-9576-47ab-8e28-87939b57d766 tempest-VolumesActionsTest-1620923889 None] Created volume successfully.
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Flow 'volume_create_manager' (0de3f1f2-8246-4ad0-b0ac-45b32278f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d473157-9838-465f-8bab-30b559986b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d473157-9838-465f-8bab-30b559986b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1720268833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e209c-8fa3-406c-bc75-ef66ceb96303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818044c42fa548e39a3c7922edf7c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:47Z,use_quota=True,user_id='bc6431cb79ae48749ff90cdf6ec48b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c97504-3779-4352-afd2-b190cbae8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c97504-3779-4352-afd2-b190cbae8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25eee37-f91a-4270-b205-7aa3bce02c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d25eee37-f91a-4270-b205-7aa3bce02c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0e209c-8fa3-406c-bc75-ef66ceb96303', 'volume_name': 'volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ad2761-f920-4c56-a2e8-912bc72282e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ad2761-f920-4c56-a2e8-912bc72282e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7894bd-557f-4c7f-a355-19f6c0c436f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Volume fe0e209c-8fa3-406c-bc75-ef66ceb96303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303', 'volume_size': 1}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1720268833',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e209c-8fa3-406c-bc75-ef66ceb96303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818044c42fa548e39a3c7922edf7c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:47Z,use_quota=True,user_id='bc6431cb79ae48749ff90cdf6ec48b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Creating volume fe0e209c-8fa3-406c-bc75-ef66ceb96303 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:47 devstack sudo[99872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 1073741824
Sep 04 06:03:47 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:48 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 1073741824" returned: 0 in 0.604s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:48 devstack sudo[99878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303
Sep 04 06:03:48 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:48 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303" returned: 0 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d7894bd-557f-4c7f-a355-19f6c0c436f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491ebf5c-e474-41e4-903d-784e5b20a28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Volume volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 (fe0e209c-8fa3-406c-bc75-ef66ceb96303): created successfully
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491ebf5c-e474-41e4-903d-784e5b20a28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Flow 'volume_create_manager' (0de3f1f2-8246-4ad0-b0ac-45b32278f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-988daebe-4c6a-466a-8bcd-fdcf2bca359c tempest-VolumesTransfersV355Test-2126052651 None] Created volume successfully.
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-4baf2af8-fb21-40d0-b51d-3b47e49d4173-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "cinder-4baf2af8-fb21-40d0-b51d-3b47e49d4173-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Acquiring lock "cinder-quobyte-4baf2af8-fb21-40d0-b51d-3b47e49d4173" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "cinder-quobyte-4baf2af8-fb21-40d0-b51d-3b47e49d4173" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d1e028-1231-489a-a4e0-2c20ca543731]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:48 devstack sudo[99881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173
Sep 04 06:03:48 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:49 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173" returned: 0 in 0.571s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:49 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173
Sep 04 06:03:49 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:49 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4baf2af8-fb21-40d0-b51d-3b47e49d4173" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "cinder-quobyte-4baf2af8-fb21-40d0-b51d-3b47e49d4173" released by "delete_volume" :: held 1.065s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Created reservations ['10bf52f9-20bd-4c83-aa10-193d7a78d2f2', 'edd10e87-644e-4ee1-8eba-71a4290ce32d', '1068994e-8179-42b8-ad25-e9f37be51c65', 'cd666a93-14c3-4c4a-92a4-dca522a4fb18'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:50 devstack sudo[99890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:50 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:50 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.318s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Deleted volume successfully.
Sep 04 06:03:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e81e4324-ed9d-477b-a0ac-67d75340318e tempest-VolumesActionsTest-1620923889 None] Lock "cinder-4baf2af8-fb21-40d0-b51d-3b47e49d4173-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-60e45418-158a-4c3d-bef8-2ffc5eff9702 tempest-VolumesTransfersV355Test-1405863262 None] Transfer volume completed successfully.
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "cinder-fe0e209c-8fa3-406c-bc75-ef66ceb96303-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-fe0e209c-8fa3-406c-bc75-ef66ceb96303-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "cinder-quobyte-fe0e209c-8fa3-406c-bc75-ef66ceb96303" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-quobyte-fe0e209c-8fa3-406c-bc75-ef66ceb96303" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd25ae7e-d3bc-4b57-9b92-587c42684fae]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:52 devstack sudo[99894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303
Sep 04 06:03:52 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:52 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:52 devstack sudo[99899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303
Sep 04 06:03:52 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:52 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fe0e209c-8fa3-406c-bc75-ef66ceb96303" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-quobyte-fe0e209c-8fa3-406c-bc75-ef66ceb96303" released by "delete_volume" :: held 0.786s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=156,cinder:SELECT=115,cinder:INSERT=34,cinder:DELETE=15 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=116,cinder:INSERT=37,cinder:UPDATE=150,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Created reservations ['80069ea1-4b16-4dc0-b8cb-a4fdd6917543', 'aba62def-08f0-4e0d-b983-46d04e508427', '8fe2c5b4-f4db-482f-9061-71100d1ae58b', '8d19b86a-2b58-4b6d-a874-1bd42debc535'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cbe6657f-0893-43e8-b0a0-6eadaff8daa7 tempest-BackendsCapabilitiesAdminTestsJSON-544806367 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f06378a6-f1eb-4d44-a3a9-697381e1671f tempest-BackendsCapabilitiesAdminTestsJSON-544806367 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 06:03:53 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:53 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:53 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Deleted volume successfully.
Sep 04 06:03:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d3cf7dca-632b-46e5-bd2a-c59d50160b98 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-fe0e209c-8fa3-406c-bc75-ef66ceb96303-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Flow 'volume_create_manager' (8ce35d01-723b-4c29-baf2-b047a1c9c513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd85a8cd-e32e-452d-85d2-1a3e74fc4bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd85a8cd-e32e-452d-85d2-1a3e74fc4bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-435503435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818044c42fa548e39a3c7922edf7c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:54Z,use_quota=True,user_id='bc6431cb79ae48749ff90cdf6ec48b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc4116d-f5f8-467f-a32b-3c0438b8defc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fc4116d-f5f8-467f-a32b-3c0438b8defc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea35c02-91ee-4a2b-8381-e8e407dce512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea35c02-91ee-4a2b-8381-e8e407dce512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc', 'volume_name': 'volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35067b79-3b29-4913-9f53-eff4ac4056a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35067b79-3b29-4913-9f53-eff4ac4056a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbce796-a802-46ec-81d2-2d6ab3289899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Volume d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc', 'volume_size': 1}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-435503435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='818044c42fa548e39a3c7922edf7c210',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:03:54Z,use_quota=True,user_id='bc6431cb79ae48749ff90cdf6ec48b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Creating volume d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:03:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:03:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:54 devstack sudo[99908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc 1073741824
Sep 04 06:03:54 devstack sudo[99908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:55 devstack sudo[99908]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc 1073741824" returned: 0 in 0.654s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:55 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc
Sep 04 06:03:55 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:55 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fbce796-a802-46ec-81d2-2d6ab3289899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114f32e-1d84-4dc4-8841-ff18a56c96b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:03:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Volume volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc (d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc): created successfully
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3114f32e-1d84-4dc4-8841-ff18a56c96b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:03:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Flow 'volume_create_manager' (8ce35d01-723b-4c29-baf2-b047a1c9c513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:03:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-91fdfa2c-8900-455c-a365-df8617f00eca tempest-VolumesTransfersV355Test-2126052651 None] Created volume successfully.
Sep 04 06:03:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "cinder-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "cinder-quobyte-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-quobyte-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e108c54-2bb9-477d-89de-ad5e2ac83127]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:57 devstack sudo[99917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc
Sep 04 06:03:57 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:57 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:57 devstack sudo[99922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc
Sep 04 06:03:57 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:57 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-quobyte-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc" released by "delete_volume" :: held 0.910s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Created reservations ['f5d46bfd-5743-401f-be75-89f1ad90e2ab', '0c57e797-ae96-41fb-997a-f9ed1b554cd5', '5d461fc8-7e0d-4d0b-8da0-ca6506d7736b', 'bda4bf5d-b015-4da1-a866-d423d3ab7caa'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:03:58 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:03:58 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:03:58 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:03:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Deleted volume successfully.
Sep 04 06:03:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-32a587e5-0325-4e73-b100-1d1eef0385a7 tempest-VolumesTransfersV355Test-1806280575 None] Lock "cinder-d4cb15e6-b79f-48b6-b35a-1c45a7bb1fbc-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3b4dc752-644a-44ce-a2f3-aabf74f4304a tempest-GroupsTest-818504710 None] Group tempest-Group1-1716732642: creating
Sep 04 06:04:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3b4dc752-644a-44ce-a2f3-aabf74f4304a tempest-GroupsTest-818504710 None] Group tempest-Group1-1716732642: created successfully
Sep 04 06:04:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3b4dc752-644a-44ce-a2f3-aabf74f4304a tempest-GroupsTest-818504710 None] Create group completed successfully.
Sep 04 06:04:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e956c72-8d27-45c7-9628-30b3f6921d20 tempest-GroupsTest-818504710 None] Group tempest-Group2-2093019818: creating
Sep 04 06:04:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e956c72-8d27-45c7-9628-30b3f6921d20 tempest-GroupsTest-818504710 None] Group tempest-Group2-2093019818: created successfully
Sep 04 06:04:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3e956c72-8d27-45c7-9628-30b3f6921d20 tempest-GroupsTest-818504710 None] Create group completed successfully.
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (fdff07e3-3aae-4982-a06a-5fe596696743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809b20ff-6a89-4f73-ae26-f0f28f60f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809b20ff-6a89-4f73-ae26-f0f28f60f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-703674218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97aeba28-5339-4e68-9c5b-9ab400bbef9c,host='devstack@QuobyteHD#QuobyteHD',id=1714c6f2-160e-4e36-abd2-36e792ab610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:05Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4be7c139-ed56-4131-b7dd-c00fb1dcff56),volume_type_id=4be7c139-ed56-4131-b7dd-c00fb1dcff56)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ab281-cd15-44ee-be7b-c3c197fd9bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697ab281-cd15-44ee-be7b-c3c197fd9bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa798892-b8c4-4dcb-9f30-883a2a008b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa798892-b8c4-4dcb-9f30-883a2a008b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1714c6f2-160e-4e36-abd2-36e792ab610d', 'volume_name': 'volume-1714c6f2-160e-4e36-abd2-36e792ab610d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa20b945-2832-41d5-98b7-0142adedcd8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa20b945-2832-41d5-98b7-0142adedcd8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d759-ad17-4428-a43a-f78a71bd8d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Volume 1714c6f2-160e-4e36-abd2-36e792ab610d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1714c6f2-160e-4e36-abd2-36e792ab610d', 'volume_size': 1}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=97aeba28-5339-4e68-9c5b-9ab400bbef9c,created_at=2026-09-04T04:04:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-703674218',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=97aeba28-5339-4e68-9c5b-9ab400bbef9c,host='devstack@QuobyteHD#QuobyteHD',id=1714c6f2-160e-4e36-abd2-36e792ab610d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:05Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4be7c139-ed56-4131-b7dd-c00fb1dcff56),volume_type_id=4be7c139-ed56-4131-b7dd-c00fb1dcff56)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Creating volume 1714c6f2-160e-4e36-abd2-36e792ab610d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:05 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:05 devstack sudo[99985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d 1073741824
Sep 04 06:04:05 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:05 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d 1073741824" returned: 0 in 0.633s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:05 devstack sudo[99991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d
Sep 04 06:04:05 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:06 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d" returned: 0 in 0.484s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a031d759-ad17-4428-a43a-f78a71bd8d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1714c6f2-160e-4e36-abd2-36e792ab610d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9979927f-3bd9-4d41-b838-b4e80752af4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Volume volume-1714c6f2-160e-4e36-abd2-36e792ab610d (1714c6f2-160e-4e36-abd2-36e792ab610d): created successfully
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9979927f-3bd9-4d41-b838-b4e80752af4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (fdff07e3-3aae-4982-a06a-5fe596696743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f9a4f0c3-4064-4ca4-b4ee-f6005fe5b781 tempest-GroupsTest-818504710 None] Created volume successfully.
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Acquiring lock "cinder-quobyte-1714c6f2-160e-4e36-abd2-36e792ab610d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-1714c6f2-160e-4e36-abd2-36e792ab610d" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adeaf5a-d12e-4615-a1d8-863708d41295]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:08 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d
Sep 04 06:04:08 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:08 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:08 devstack sudo[100000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d
Sep 04 06:04:08 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:09 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1714c6f2-160e-4e36-abd2-36e792ab610d" returned: 0 in 0.349s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-1714c6f2-160e-4e36-abd2-36e792ab610d" released by "delete_volume" :: held 0.915s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Created reservations ['39dc7504-e6d9-4c82-acb0-a057dd487c24'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:09 devstack cinder-volume[87095]: WARNING cinder.quota [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1137345834 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1137345834, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:04:09 devstack cinder-volume[87095]: WARNING cinder.quota [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1137345834 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1137345834, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Created reservations ['9fd80d10-c2a5-4fec-b6de-ad97d16b9501', '9198abbe-74c0-482b-8c28-71d0a68a8b9e', '6e70bb68-959e-46cd-b0a7-3c0a8daa35fb', '8b6b3230-efb6-4a50-bbec-0834c8bdf8dd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:09 devstack sudo[100004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:09 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:09 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b7f60a67-014b-49c3-af66-361d1b882b49 tempest-GroupsTest-818504710 None] Delete group completed successfully.
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Flow 'volume_create_manager' (f82f0b45-60e2-4fa1-805b-6c7be8458582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d137d44-935a-4e5d-b5e4-0c589543682e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d137d44-935a-4e5d-b5e4-0c589543682e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-908951854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87859ccc-4394-49c6-a620-37a66c51f274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a198a1fbe94c579e8ab955656de4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:10Z,use_quota=True,user_id='2c08f6c25bae4620973266d8d771cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a00b5b-4259-4c0c-a787-a2eaef144342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a00b5b-4259-4c0c-a787-a2eaef144342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c9aa5c-92e4-4737-8975-97d065fad28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c9aa5c-92e4-4737-8975-97d065fad28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87859ccc-4394-49c6-a620-37a66c51f274', 'volume_name': 'volume-87859ccc-4394-49c6-a620-37a66c51f274', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e04c46-3eaf-4eb8-8696-1078ddafc547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e04c46-3eaf-4eb8-8696-1078ddafc547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a87b5e-2578-497b-9a24-a01584cd7ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Volume 87859ccc-4394-49c6-a620-37a66c51f274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87859ccc-4394-49c6-a620-37a66c51f274', 'volume_size': 1}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-908951854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87859ccc-4394-49c6-a620-37a66c51f274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a198a1fbe94c579e8ab955656de4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:10Z,use_quota=True,user_id='2c08f6c25bae4620973266d8d771cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Creating volume 87859ccc-4394-49c6-a620-37a66c51f274 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:10 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:10 devstack sudo[100007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 1073741824
Sep 04 06:04:10 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (9f132942-7e25-4a0d-b6d7-b989819969d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd823da-f95c-441b-98d6-29e043f62fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fd823da-f95c-441b-98d6-29e043f62fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1740065979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3508782e-3ce0-4027-b030-fd3c803508ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:11Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f7d6c9-ba71-4b08-81d5-461dc2a25e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f7d6c9-ba71-4b08-81d5-461dc2a25e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae3238-a167-4739-a567-db07b3d9f188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae3238-a167-4739-a567-db07b3d9f188) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3508782e-3ce0-4027-b030-fd3c803508ab', 'volume_name': 'volume-3508782e-3ce0-4027-b030-fd3c803508ab', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20092371-0282-4f7f-bf13-a252bbc11333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20092371-0282-4f7f-bf13-a252bbc11333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd59d2e1-f47f-477d-b48e-fd756e6ce6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Volume 3508782e-3ce0-4027-b030-fd3c803508ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3508782e-3ce0-4027-b030-fd3c803508ab', 'volume_size': 1}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 1073741824" returned: 0 in 0.626s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Created reservations ['12fcf772-ea1f-458a-974c-9b39e757423f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:10 devstack sudo[100018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274
Sep 04 06:04:10 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:11 devstack sudo[100020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:11 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:11 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.372s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:11 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1740065979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3508782e-3ce0-4027-b030-fd3c803508ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:11Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Creating volume 3508782e-3ce0-4027-b030-fd3c803508ab {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:11 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:11 devstack sudo[100024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab 1073741824
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38a87b5e-2578-497b-9a24-a01584cd7ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87859ccc-4394-49c6-a620-37a66c51f274', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:11 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562279d5-d309-4e48-a0a6-65bb76e922f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a89d15c7-96ee-4eeb-9748-c3a04144b330 tempest-GroupsTest-818504710 None] Delete group completed successfully.
Sep 04 06:04:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Volume volume-87859ccc-4394-49c6-a620-37a66c51f274 (87859ccc-4394-49c6-a620-37a66c51f274): created successfully
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (562279d5-d309-4e48-a0a6-65bb76e922f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Flow 'volume_create_manager' (f82f0b45-60e2-4fa1-805b-6c7be8458582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-52c6c73e-6b0a-4423-bab2-bc1d106030e6 tempest-VolumesTransfersV357Test-159519876 None] Created volume successfully.
Sep 04 06:04:11 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab 1073741824" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:11 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab
Sep 04 06:04:11 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:12 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd59d2e1-f47f-477d-b48e-fd756e6ce6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3508782e-3ce0-4027-b030-fd3c803508ab', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d0b90-4ea7-4818-b99f-5c7f9c7d9ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Volume volume-3508782e-3ce0-4027-b030-fd3c803508ab (3508782e-3ce0-4027-b030-fd3c803508ab): created successfully
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499d0b90-4ea7-4818-b99f-5c7f9c7d9ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (9f132942-7e25-4a0d-b6d7-b989819969d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-232fc133-7920-494a-91a2-cfac9bf2ed58 tempest-VolumesListAdminTestJSON-1345629806 None] Created volume successfully.
Sep 04 06:04:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f818470-6e2a-4b3f-9c18-227f95cf3830 tempest-GroupsTest-818504710 None] Group tempest-GroupsTest-Group-1059959482: creating
Sep 04 06:04:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f818470-6e2a-4b3f-9c18-227f95cf3830 tempest-GroupsTest-818504710 None] Group tempest-GroupsTest-Group-1059959482: created successfully
Sep 04 06:04:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f818470-6e2a-4b3f-9c18-227f95cf3830 tempest-GroupsTest-818504710 None] Create group completed successfully.
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:12 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:12 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:12 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:04:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:04:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a58f8b6d-4512-4cc5-83ac-dad3c6e8e60b tempest-VolumesTransfersV357Test-1534738459 None] Transfer volume completed successfully.
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (60c9c7d4-cf78-4ff9-a742-0b5b510cc5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584506c1-f0fa-4560-8087-b83cc8fa1e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (584506c1-f0fa-4560-8087-b83cc8fa1e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1848052455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:13Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d97ebf-751a-4501-b888-8acbd5af7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d97ebf-751a-4501-b888-8acbd5af7c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0565dd0-c87b-41be-b410-d37af203723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0565dd0-c87b-41be-b410-d37af203723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7', 'volume_name': 'volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521ec42-7c68-4883-9103-21dc4948d1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0521ec42-7c68-4883-9103-21dc4948d1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a12806-76f4-41f6-8654-2488b037be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Volume 2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7', 'volume_size': 1}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1848052455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:13Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Creating volume 2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:13 devstack sudo[100038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 1073741824
Sep 04 06:04:13 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "cinder-87859ccc-4394-49c6-a620-37a66c51f274-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-87859ccc-4394-49c6-a620-37a66c51f274-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "cinder-quobyte-87859ccc-4394-49c6-a620-37a66c51f274" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-quobyte-87859ccc-4394-49c6-a620-37a66c51f274" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b569c9-162e-45e1-a0a6-e382c91efb9e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:14 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 1073741824" returned: 0 in 0.699s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:14 devstack sudo[100044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274
Sep 04 06:04:14 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:14 devstack sudo[100046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7
Sep 04 06:04:14 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (02795c5c-5681-43d1-8b6b-63207c835ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5872a192-ceea-4dbc-a337-e95e799dc17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5872a192-ceea-4dbc-a337-e95e799dc17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511387031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6501f945-9fae-49fa-8335-fe918169e62f,host='devstack@QuobyteHD#QuobyteHD',id=5530a91d-9b3d-4a05-bf6f-df16580b7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:14Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a),volume_type_id=9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e30b2f-98f0-45fb-b52d-746e8a0fa95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e30b2f-98f0-45fb-b52d-746e8a0fa95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6cfdda-7530-4499-bffb-42504ed05d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed6cfdda-7530-4499-bffb-42504ed05d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5530a91d-9b3d-4a05-bf6f-df16580b7b8e', 'volume_name': 'volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bafbbb-3f6a-460d-8a7a-9ea503b50e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6bafbbb-3f6a-460d-8a7a-9ea503b50e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4689707-31f4-4403-8793-c13edaa8a228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Volume 5530a91d-9b3d-4a05-bf6f-df16580b7b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e', 'volume_size': 1}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:14 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6501f945-9fae-49fa-8335-fe918169e62f,created_at=2026-09-04T04:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1511387031',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6501f945-9fae-49fa-8335-fe918169e62f,host='devstack@QuobyteHD#QuobyteHD',id=5530a91d-9b3d-4a05-bf6f-df16580b7b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:14Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a),volume_type_id=9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Creating volume 5530a91d-9b3d-4a05-bf6f-df16580b7b8e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:14 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:14 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274" returned: 0 in 0.610s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:14 devstack sudo[100052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e 1073741824
Sep 04 06:04:14 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a12806-76f4-41f6-8654-2488b037be69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2ee2c-eee4-4802-a58d-1dcfc099ee2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:14 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274
Sep 04 06:04:14 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Volume volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 (2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7): created successfully
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6e2ee2c-eee4-4802-a58d-1dcfc099ee2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (60c9c7d4-cf78-4ff9-a742-0b5b510cc5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-97a79045-7cc8-4fb4-b168-c4f1cb053fbc tempest-VolumesListAdminTestJSON-1345629806 None] Created volume successfully.
Sep 04 06:04:15 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-87859ccc-4394-49c6-a620-37a66c51f274" returned: 0 in 0.344s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-quobyte-87859ccc-4394-49c6-a620-37a66c51f274" released by "delete_volume" :: held 1.027s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Created reservations ['6a91e342-8d21-4c91-8c54-349b540a3673', '6a5d5c59-8375-4677-8e54-f9eae143de2a', 'b3b8225a-40c3-421e-913e-33da91b495a5', '5ea62fe4-ac38-4039-b4f5-ccb9ffd73db6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:15 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e 1073741824" returned: 0 in 0.536s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:15 devstack sudo[100061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:15 devstack sudo[100061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:15 devstack sudo[100063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e
Sep 04 06:04:15 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:15 devstack sudo[100061]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.350s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Deleted volume successfully.
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-a19b7c34-dff8-4e01-8fc0-356a9496291a tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-87859ccc-4394-49c6-a620-37a66c51f274-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:15 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4689707-31f4-4403-8793-c13edaa8a228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a657eeb5-a378-4df7-8298-1871215861a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Volume volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e (5530a91d-9b3d-4a05-bf6f-df16580b7b8e): created successfully
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a657eeb5-a378-4df7-8298-1871215861a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (02795c5c-5681-43d1-8b6b-63207c835ac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a0f10fe2-5f11-4621-9a9f-cb260ae60512 tempest-GroupsTest-818504710 None] Created volume successfully.
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (334235ca-ab0a-43f3-8def-5acc8e198cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aae942-57cc-4272-9e48-4962b73f0753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8aae942-57cc-4272-9e48-4962b73f0753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004277209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dec749e-fe14-4faa-bd4d-e68f3793086c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b07c50-b3bf-4a8f-9eb7-d67e150027de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b07c50-b3bf-4a8f-9eb7-d67e150027de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab71d8f7-c398-41b4-a0c9-0e943ea8ff46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab71d8f7-c398-41b4-a0c9-0e943ea8ff46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dec749e-fe14-4faa-bd4d-e68f3793086c', 'volume_name': 'volume-1dec749e-fe14-4faa-bd4d-e68f3793086c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cda253-bb20-4c16-a0e0-d4d5f6e3a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cda253-bb20-4c16-a0e0-d4d5f6e3a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9222deee-90c6-4123-85ea-086472128084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Volume 1dec749e-fe14-4faa-bd4d-e68f3793086c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dec749e-fe14-4faa-bd4d-e68f3793086c', 'volume_size': 1}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2004277209',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dec749e-fe14-4faa-bd4d-e68f3793086c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='182ffa20f57b4ac99377a4794c530d4a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:16Z,use_quota=True,user_id='2529113e23f2440399cdaffcc4a41f76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Creating volume 1dec749e-fe14-4faa-bd4d-e68f3793086c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:16 devstack sudo[100091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c 1073741824
Sep 04 06:04:16 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Flow 'volume_create_manager' (e30d41b6-d29f-4ed8-87d8-7b62b7019488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1f1977-ecf9-42ac-ab89-ed6edbfbfb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f1f1977-ecf9-42ac-ab89-ed6edbfbfb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-448061501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12dd9a6-1df5-4c82-9756-4537c5c25829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a198a1fbe94c579e8ab955656de4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:17Z,use_quota=True,user_id='2c08f6c25bae4620973266d8d771cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946b395a-b36b-4f53-9e83-1157468f9e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946b395a-b36b-4f53-9e83-1157468f9e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0c856c-d669-4476-a624-0f0a6df7f832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0c856c-d669-4476-a624-0f0a6df7f832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12dd9a6-1df5-4c82-9756-4537c5c25829', 'volume_name': 'volume-a12dd9a6-1df5-4c82-9756-4537c5c25829', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a200b95b-5c96-4485-a2aa-74aa6caa83f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a200b95b-5c96-4485-a2aa-74aa6caa83f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d43888-7447-4886-bc82-d3b963321778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Volume a12dd9a6-1df5-4c82-9756-4537c5c25829: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12dd9a6-1df5-4c82-9756-4537c5c25829', 'volume_size': 1}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:17 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c 1073741824" returned: 0 in 0.502s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:17 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c
Sep 04 06:04:17 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:17 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.302s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-448061501',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12dd9a6-1df5-4c82-9756-4537c5c25829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60a198a1fbe94c579e8ab955656de4eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:17Z,use_quota=True,user_id='2c08f6c25bae4620973266d8d771cd17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Creating volume a12dd9a6-1df5-4c82-9756-4537c5c25829 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:17 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9222deee-90c6-4123-85ea-086472128084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dec749e-fe14-4faa-bd4d-e68f3793086c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack sudo[100100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 1073741824
Sep 04 06:04:17 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66cf4c-c3dd-46fc-a75b-6529889baf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Volume volume-1dec749e-fe14-4faa-bd4d-e68f3793086c (1dec749e-fe14-4faa-bd4d-e68f3793086c): created successfully
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f66cf4c-c3dd-46fc-a75b-6529889baf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Flow 'volume_create_manager' (334235ca-ab0a-43f3-8def-5acc8e198cbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:17 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d4e2917b-76e5-4eea-a071-aef04608f065 tempest-VolumesListAdminTestJSON-1345629806 None] Created volume successfully.
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (35b48dd6-c746-460b-86ac-e8f0ec5a9fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbd2924-e75c-486f-8099-850273722f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acbd2924-e75c-486f-8099-850273722f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899751605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6501f945-9fae-49fa-8335-fe918169e62f,host='devstack@QuobyteHD#QuobyteHD',id=0c3022c7-a933-42ce-a796-1e71ee08b62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:18Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a),volume_type_id=9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703cc21e-4091-4d9a-a5a1-94981364e5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703cc21e-4091-4d9a-a5a1-94981364e5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21f9509-ab12-4421-b3d8-677b9c219512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c21f9509-ab12-4421-b3d8-677b9c219512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c3022c7-a933-42ce-a796-1e71ee08b62e', 'volume_name': 'volume-0c3022c7-a933-42ce-a796-1e71ee08b62e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526a788-6b48-4df2-9d3d-fe0cd656c1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e526a788-6b48-4df2-9d3d-fe0cd656c1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f578e4f-cbca-4741-8c97-ac9f43d9b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:17 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Volume 0c3022c7-a933-42ce-a796-1e71ee08b62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c3022c7-a933-42ce-a796-1e71ee08b62e', 'volume_size': 1}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:17 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 1073741824" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:17 devstack sudo[100106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829
Sep 04 06:04:17 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:18 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829" returned: 0 in 0.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6501f945-9fae-49fa-8335-fe918169e62f,created_at=2026-09-04T04:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1899751605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6501f945-9fae-49fa-8335-fe918169e62f,host='devstack@QuobyteHD#QuobyteHD',id=0c3022c7-a933-42ce-a796-1e71ee08b62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9d963b8419742d6a179d6189edc32cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:18Z,use_quota=True,user_id='73dd596a54f24541879b38c0efe78d90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a),volume_type_id=9dba5fc1-ce0d-4540-b92c-3f2371a3fd3a)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Creating volume 0c3022c7-a933-42ce-a796-1e71ee08b62e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d43888-7447-4886-bc82-d3b963321778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12dd9a6-1df5-4c82-9756-4537c5c25829', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:18 devstack sudo[100109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e 1073741824
Sep 04 06:04:18 devstack sudo[100109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac68de30-90ba-43ef-a8c6-d23c29c1e65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Volume volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 (a12dd9a6-1df5-4c82-9756-4537c5c25829): created successfully
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac68de30-90ba-43ef-a8c6-d23c29c1e65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Flow 'volume_create_manager' (e30d41b6-d29f-4ed8-87d8-7b62b7019488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-091998bd-2088-44b8-9a08-a6f6f91a1f38 tempest-VolumesTransfersV357Test-159519876 None] Created volume successfully.
Sep 04 06:04:18 devstack sudo[100109]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e 1073741824" returned: 0 in 0.444s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:18 devstack sudo[100115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e
Sep 04 06:04:18 devstack sudo[100115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:18 devstack sudo[100115]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f578e4f-cbca-4741-8c97-ac9f43d9b9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c3022c7-a933-42ce-a796-1e71ee08b62e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2131f8-336e-4385-8aca-e4092d94d0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Volume volume-0c3022c7-a933-42ce-a796-1e71ee08b62e (0c3022c7-a933-42ce-a796-1e71ee08b62e): created successfully
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf2131f8-336e-4385-8aca-e4092d94d0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Flow 'volume_create_manager' (35b48dd6-c746-460b-86ac-e8f0ec5a9fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-600a6b2a-1ffd-4822-a97b-ea1b0352d108 tempest-GroupsTest-818504710 None] Created volume successfully.
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Flow 'volume_create_manager' (27b5498e-d1ef-404f-be67-bb064d2b5fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb79734-24b4-4278-8ef0-4ba5f56be7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb79734-24b4-4278-8ef0-4ba5f56be7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c3c14a-f125-4440-814e-5852dcaf2075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697993ba27184e25a892f76d7d7df6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:19Z,use_quota=True,user_id='f2853dcb4dea4c35b247811f4ebafa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a4e76-c396-40ce-86c9-7d3c48f1a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9a4e76-c396-40ce-86c9-7d3c48f1a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d6215e-664d-4a7a-96c7-55c6fb41cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18d6215e-664d-4a7a-96c7-55c6fb41cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08c3c14a-f125-4440-814e-5852dcaf2075', 'volume_name': 'volume-08c3c14a-f125-4440-814e-5852dcaf2075', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d11e2-3cf3-405e-97fc-a3bfcb7f7acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858d11e2-3cf3-405e-97fc-a3bfcb7f7acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667fc613-d37a-4e8c-94eb-d4a7c88770ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Volume 08c3c14a-f125-4440-814e-5852dcaf2075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08c3c14a-f125-4440-814e-5852dcaf2075', 'volume_size': 1}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08c3c14a-f125-4440-814e-5852dcaf2075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='697993ba27184e25a892f76d7d7df6a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:19Z,use_quota=True,user_id='f2853dcb4dea4c35b247811f4ebafa00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Creating volume 08c3c14a-f125-4440-814e-5852dcaf2075 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:19 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:19 devstack sudo[100118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 1073741824
Sep 04 06:04:19 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "cinder-a12dd9a6-1df5-4c82-9756-4537c5c25829-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-a12dd9a6-1df5-4c82-9756-4537c5c25829-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "cinder-quobyte-a12dd9a6-1df5-4c82-9756-4537c5c25829" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-quobyte-a12dd9a6-1df5-4c82-9756-4537c5c25829" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15aae6d-d51b-49e2-a8a3-8cdf683a6601]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:19 devstack sudo[100120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829
Sep 04 06:04:19 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:19 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 1073741824" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:19 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075
Sep 04 06:04:19 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:19 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829" returned: 0 in 0.456s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:19 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829
Sep 04 06:04:19 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:20 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667fc613-d37a-4e8c-94eb-d4a7c88770ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08c3c14a-f125-4440-814e-5852dcaf2075', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d1025c-e696-4d24-8a9c-4d8c911cb7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Volume volume-08c3c14a-f125-4440-814e-5852dcaf2075 (08c3c14a-f125-4440-814e-5852dcaf2075): created successfully
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d1025c-e696-4d24-8a9c-4d8c911cb7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Flow 'volume_create_manager' (27b5498e-d1ef-404f-be67-bb064d2b5fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6cdb3767-5955-4745-bc0a-0f2765a7e615 tempest-VolumesListAdminTestJSON-1671426905 None] Created volume successfully.
Sep 04 06:04:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-01cc6fa8-b1c9-48fe-a795-51fe166833e4 tempest-GroupsTest-818504710 None] Update group completed successfully.
Sep 04 06:04:20 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a12dd9a6-1df5-4c82-9756-4537c5c25829" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-quobyte-a12dd9a6-1df5-4c82-9756-4537c5c25829" released by "delete_volume" :: held 0.826s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Created reservations ['197c1461-351c-44c4-bd7c-4a55790af3ac', '3deadb04-ed03-4bfb-bbf1-aa03420c1d71', '4ef037cd-3400-4e62-b305-57903e7a549b', '8e40eacb-0ec6-4ba5-b8a5-86e7d578aee8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:20 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:20 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:20 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Deleted volume successfully.
Sep 04 06:04:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af892ae-1b12-40af-96e1-5b97ed280f14 tempest-VolumesTransfersV357Test-2142241104 None] Lock "cinder-a12dd9a6-1df5-4c82-9756-4537c5c25829-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-61a66d65-b25c-4980-85d4-53436df4ab57 tempest-GroupsTest-818504710 None] Update group completed successfully.
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Acquiring lock "cinder-08c3c14a-f125-4440-814e-5852dcaf2075-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "cinder-08c3c14a-f125-4440-814e-5852dcaf2075-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Acquiring lock "cinder-quobyte-08c3c14a-f125-4440-814e-5852dcaf2075" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "cinder-quobyte-08c3c14a-f125-4440-814e-5852dcaf2075" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28a137c-6756-4293-b95d-e818378b6686]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-1dec749e-fe14-4faa-bd4d-e68f3793086c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-1dec749e-fe14-4faa-bd4d-e68f3793086c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-quobyte-1dec749e-fe14-4faa-bd4d-e68f3793086c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-1dec749e-fe14-4faa-bd4d-e68f3793086c" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2571d-08ef-44a1-9e9b-690c550719dd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:21 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075
Sep 04 06:04:21 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:21 devstack sudo[100140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c
Sep 04 06:04:21 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:22 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:22 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075
Sep 04 06:04:22 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:22 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c" returned: 0 in 0.444s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:22 devstack sudo[100150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c
Sep 04 06:04:22 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:22 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-08c3c14a-f125-4440-814e-5852dcaf2075" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "cinder-quobyte-08c3c14a-f125-4440-814e-5852dcaf2075" released by "delete_volume" :: held 0.818s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Created reservations ['c67ca6e5-fbea-44eb-89f4-0416dbabdefc', '76312c6e-328e-4b93-ac6d-1e485c238386', '01fdf64e-b6cd-4ebf-b4d5-543eda31e746', '0a03a272-f02d-4541-bab8-dc9f49677bf6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:22 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1dec749e-fe14-4faa-bd4d-e68f3793086c" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-1dec749e-fe14-4faa-bd4d-e68f3793086c" released by "delete_volume" :: held 0.821s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:22 devstack sudo[100154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:22 devstack sudo[100154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Created reservations ['ed5dd653-6ed0-4f1d-aec0-0cd4b251efe4', 'f0bc3025-d322-4530-84fd-fd31e27a027b', '6fc23da3-262d-4d38-adf8-da7532255284', '5ef87862-50d8-4d4a-8cdb-d56858cbacd0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:22 devstack sudo[100154]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:22 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:22 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:22 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Deleted volume successfully.
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5ec745e1-f38a-48a6-9d5c-d1f3c6d9162d tempest-VolumesListAdminTestJSON-1671426905 None] Lock "cinder-08c3c14a-f125-4440-814e-5852dcaf2075-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-quobyte-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:23 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Deleted volume successfully.
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[223cb82d-9a37-4588-a8cb-4091753f04e9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b8bb46b-118a-4d6e-9235-b99a312da435 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-1dec749e-fe14-4faa-bd4d-e68f3793086c-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:23 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7
Sep 04 06:04:23 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Acquiring lock "cinder-quobyte-0c3022c7-a933-42ce-a796-1e71ee08b62e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-0c3022c7-a933-42ce-a796-1e71ee08b62e" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f6bc31-ccbc-4d95-bd19-7cbf918f48c8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:23 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e
Sep 04 06:04:23 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:23 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" returned: 0 in 0.615s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:24 devstack sudo[100167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7
Sep 04 06:04:24 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:24 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e" returned: 0 in 0.642s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:24 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" returned: 0 in 0.402s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:24 devstack sudo[100174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e
Sep 04 06:04:24 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7" released by "delete_volume" :: held 1.104s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Created reservations ['0313a4fb-91e7-4af9-9456-d6b0e2520f2b', '8dc935da-cad9-4295-ba76-da7f71d63e9e', '2d4d76fc-2d95-41db-8cc9-67f68699937f', 'e6b878d1-ea8b-484f-9d2f-9b299ae1d017'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:24 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:24 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:24 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0c3022c7-a933-42ce-a796-1e71ee08b62e" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-0c3022c7-a933-42ce-a796-1e71ee08b62e" released by "delete_volume" :: held 1.091s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Acquiring lock "cinder-quobyte-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bbbe3-4c64-4f49-b861-0cd88553cebf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:24 devstack sudo[100179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e
Sep 04 06:04:24 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:25 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.515s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Deleted volume successfully.
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-477a81e2-0b74-41e1-af33-4598f7d3d41c tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-2ae1d9e1-e80b-4ba8-8c29-cba42f9badc7-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:25 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" returned: 0 in 0.594s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:25 devstack sudo[100185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e
Sep 04 06:04:25 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-3508782e-3ce0-4027-b030-fd3c803508ab-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-3508782e-3ce0-4027-b030-fd3c803508ab-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:25 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "cinder-quobyte-3508782e-3ce0-4027-b030-fd3c803508ab" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "cinder-quobyte-5530a91d-9b3d-4a05-bf6f-df16580b7b8e" released by "delete_volume" :: held 1.120s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-3508782e-3ce0-4027-b030-fd3c803508ab" acquired by "delete_volume" :: waited 0.081s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[456bac3b-fe3f-47b8-89dd-4e9779f459a1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Created reservations ['6ace275a-a1b0-41d0-857b-9246aecb2199'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:26 devstack cinder-volume[87095]: WARNING cinder.quota [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-96919827 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-96919827, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:04:26 devstack cinder-volume[87095]: WARNING cinder.quota [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-96919827 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-96919827, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:04:26 devstack sudo[100188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab
Sep 04 06:04:26 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Created reservations ['99753fba-9486-4de7-9c25-6f9cb8b136fd', '60c6a293-5cf3-4f07-8502-492c5ddced8c', 'aa314253-a062-4ae4-8f61-486d85d0085e', 'ef49fe25-a20f-4d9d-8def-634853ef7779'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Created reservations ['a8f897d4-eb9a-45e7-bd3d-b36337a5a95c', '9bf00a17-2528-4604-9f60-e83ca0c7e601', '992d62bd-6d2e-4699-9ea1-93273b01d60b', '00b62d28-5b2d-4e43-a3a3-ac49b7e959e3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:26 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:26 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:26 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:26 devstack sudo[100195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab
Sep 04 06:04:26 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:26 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e226757-c1ad-4c27-8c71-170e701403e1 tempest-GroupsTest-818504710 None] Delete group completed successfully.
Sep 04 06:04:26 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3508782e-3ce0-4027-b030-fd3c803508ab" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-quobyte-3508782e-3ce0-4027-b030-fd3c803508ab" released by "delete_volume" :: held 0.957s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Created reservations ['61e2472c-ca3b-46e1-8d42-0170521c8fff', 'a92353b1-1fe4-4e0f-93bb-87eb1d363426', '69e0f571-4f19-4c05-9be7-9c2842ed1fd6', '65595135-85d1-4dc3-bd00-c7552af60854'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:27 devstack sudo[100200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:27 devstack sudo[100200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:27 devstack sudo[100200]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:27 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Deleted volume successfully.
Sep 04 06:04:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cafe207f-d62e-48de-8f58-f4b5f3059875 tempest-VolumesListAdminTestJSON-1345629806 None] Lock "cinder-3508782e-3ce0-4027-b030-fd3c803508ab-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Flow 'volume_create_manager' (9463259e-8351-4dff-bff3-a32bfa475a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2309ebc7-5e50-46a9-941a-e3753f188181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2309ebc7-5e50-46a9-941a-e3753f188181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-431312852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6eddc5-6c24-435c-9058-5d46a3ed7edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c7d126d684ab4af995f6f2a439aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:28Z,use_quota=True,user_id='4cbf7eba306c451a97582487ddb4a20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26ff48-1d4f-40a3-a58c-de12b55d7bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e26ff48-1d4f-40a3-a58c-de12b55d7bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053e2fa-9aef-4d0f-a8ff-f51349270eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:28 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6053e2fa-9aef-4d0f-a8ff-f51349270eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4a6eddc5-6c24-435c-9058-5d46a3ed7edf', 'volume_name': 'volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3f8f0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffc9f8f-6bba-44fa-afb6-57bbf8ff2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffc9f8f-6bba-44fa-afb6-57bbf8ff2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63265cc0-886c-43dd-8eeb-de37353aba01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3f8f0>}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Trying to clone 4a6eddc5-6c24-435c-9058-5d46a3ed7edf from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:04:29 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[04260a8a-698b-4fa8-8389-0d71fe7f9061]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:29 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD
Sep 04 06:04:29 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:30 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 is fetched for user 4cbf7eba306c451a97582487ddb4a20a. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23f7d45-5541-488b-b824-73c0b035d5a2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:30 devstack sudo[100210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD
Sep 04 06:04:30 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:30 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-431312852',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6eddc5-6c24-435c-9058-5d46a3ed7edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c7d126d684ab4af995f6f2a439aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:28Z,use_quota=True,user_id='4cbf7eba306c451a97582487ddb4a20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Creating volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:30 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:30 devstack sudo[100216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1073741824
Sep 04 06:04:30 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:31 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1073741824" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:31 devstack sudo[100222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf
Sep 04 06:04:31 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:31 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Attempting download of c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe21109-4f03-4c65-aa8b-c115cf875322]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:31 devstack sudo[100225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8
Sep 04 06:04:31 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:32 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:32 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8
Sep 04 06:04:32 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:32 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8" returned: 1 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_t98qq1p8' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac69fa25-5b3c-47ab-8d9c-a4ac0c7f3244]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:32 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD
Sep 04 06:04:32 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:32 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] c1c4afc1-734f-46ce-9589-8a0fba4d2421 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:04:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:32 devstack sudo[100274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf
Sep 04 06:04:32 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Flow 'volume_create_manager' (5a3bb752-5cf4-4e3d-8be5-bb0ba030e649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d736a4-8aa7-47a8-8d97-81577027ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d736a4-8aa7-47a8-8d97-81577027ec39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1206952237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b77091-6e26-44c3-866d-e14e5545d730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8ad5061a20420fac69f205448a435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:33Z,use_quota=True,user_id='c39c35c0903d412fb2c254cf78a2687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4738f20-cd40-476a-b0bc-84b68353f2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4738f20-cd40-476a-b0bc-84b68353f2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69718eb5-2327-47a3-a5a5-c38f1bdf104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69718eb5-2327-47a3-a5a5-c38f1bdf104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8b77091-6e26-44c3-866d-e14e5545d730', 'volume_name': 'volume-a8b77091-6e26-44c3-866d-e14e5545d730', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bf1cc0-29db-4889-8753-9442918d1cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1bf1cc0-29db-4889-8753-9442918d1cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a17a5f8-5c10-4ee2-a0eb-3e1c385125e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Volume a8b77091-6e26-44c3-866d-e14e5545d730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8b77091-6e26-44c3-866d-e14e5545d730', 'volume_size': 1}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1206952237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8b77091-6e26-44c3-866d-e14e5545d730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8ad5061a20420fac69f205448a435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:33Z,use_quota=True,user_id='c39c35c0903d412fb2c254cf78a2687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Creating volume a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:33 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 1073741824
Sep 04 06:04:33 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:34 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 1073741824" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:34 devstack sudo[100291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:34 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:34 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a17a5f8-5c10-4ee2-a0eb-3e1c385125e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8b77091-6e26-44c3-866d-e14e5545d730', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177061ee-67ef-4c3b-a85e-9ea4b4e5b9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Volume volume-a8b77091-6e26-44c3-866d-e14e5545d730 (a8b77091-6e26-44c3-866d-e14e5545d730): created successfully
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (177061ee-67ef-4c3b-a85e-9ea4b4e5b9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Flow 'volume_create_manager' (5a3bb752-5cf4-4e3d-8be5-bb0ba030e649) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ca45d34b-9c39-4f08-b558-d5c0dd8adf3c tempest-VolumesCloneTest-2010496983 None] Created volume successfully.
Sep 04 06:04:34 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" returned: 0 in 1.977s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_jhiojdezdevstack@QuobyteHD, size 112.00 MB, duration 1.98 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:04:34 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Converted 112.00 MB image at 56.63 MB/s
Sep 04 06:04:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:34 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1G
Sep 04 06:04:34 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:35 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 1G" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Downloaded image c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 for user 4cbf7eba306c451a97582487ddb4a20a is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Marking volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Copying metadata from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 to 4a6eddc5-6c24-435c-9058-5d46a3ed7edf. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Creating volume glance metadata for volume 4a6eddc5-6c24-435c-9058-5d46a3ed7edf backed by image c1c4afc1-734f-46ce-9589-8a0fba4d2421 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63265cc0-886c-43dd-8eeb-de37353aba01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028c3f8f0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe8d0ad-3be3-455b-a165-d99e1aecf85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Volume volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf (4a6eddc5-6c24-435c-9058-5d46a3ed7edf): created successfully
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe8d0ad-3be3-455b-a165-d99e1aecf85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Flow 'volume_create_manager' (9463259e-8351-4dff-bff3-a32bfa475a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-63106866-872a-4272-88da-2d78e19652ca tempest-VolumesExtendTest-1638110505 None] Created volume successfully.
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Flow 'volume_create_manager' (90758bd9-9851-42ca-962e-5279115cf98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc7c931-c92e-4f29-9c99-9838e3b6c5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[458ba1fa-96d7-4d86-b7ce-02e5a2e843cf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdc7c931-c92e-4f29-9c99-9838e3b6c5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-155468685',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d8ed30-e61a-4021-b460-1f67cf02a7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d8ad5061a20420fac69f205448a435d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=a8b77091-6e26-44c3-866d-e14e5545d730,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:36Z,use_quota=True,user_id='c39c35c0903d412fb2c254cf78a2687c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6452d9bd-64e4-4c04-bd4b-2ae6a08a2eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6452d9bd-64e4-4c04-bd4b-2ae6a08a2eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e582eaf-3221-4eb0-b37f-6a238da5953d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e582eaf-3221-4eb0-b37f-6a238da5953d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '17d8ed30-e61a-4021-b460-1f67cf02a7d6', 'volume_name': 'volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6', 'volume_size': 2, 'source_volid': 'a8b77091-6e26-44c3-866d-e14e5545d730', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8237690d-d28c-43d0-8397-7e2aa4d7d61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8237690d-d28c-43d0-8397-7e2aa4d7d61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ca7907-cccb-4d3b-8806-8100288afca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Volume 17d8ed30-e61a-4021-b460-1f67cf02a7d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6', 'volume_size': 2, 'source_volid': 'a8b77091-6e26-44c3-866d-e14e5545d730', 'source_volstatus': 'available'}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:36 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf
Sep 04 06:04:36 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:36 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" returned: 0 in 0.395s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf 2G" returned: 0 in 0.098s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.535s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.383s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:36 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Cloning volume a8b77091-6e26-44c3-866d-e14e5545d730 to volume 17d8ed30-e61a-4021-b460-1f67cf02a7d6
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Creating offline snapshot 97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 of volume a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00bc991-c4f4-45e2-b65b-c1dd4a7224f9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65eed2c9-fbe0-49be-95f8-1106b64b64cd tempest-VolumesExtendTest-1638110505 None] Extend volume completed successfully.
Sep 04 06:04:36 devstack sudo[100307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:36 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:37 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:37 devstack sudo[100312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 1G
Sep 04 06:04:37 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-4a6eddc5-6c24-435c-9058-5d46a3ed7edf-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-4a6eddc5-6c24-435c-9058-5d46a3ed7edf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-quobyte-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[17000120-731f-4075-b5c1-13e62535bb5d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:37 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 1G" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b77091-6e26-44c3-866d-e14e5545d730 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:37 devstack sudo[100319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b77091-6e26-44c3-866d-e14e5545d730 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:37 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:37 devstack sudo[100318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf
Sep 04 06:04:37 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:37 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8b77091-6e26-44c3-866d-e14e5545d730 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 is being set with open permissions: ugo+rw
Sep 04 06:04:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:37 devstack sudo[100327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:37 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:38 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:38 devstack sudo[100331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf
Sep 04 06:04:38 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:38 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:38 devstack sudo[100334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info
Sep 04 06:04:38 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:38 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-4a6eddc5-6c24-435c-9058-5d46a3ed7edf" released by "delete_volume" :: held 0.764s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Created reservations ['6514e4ab-8db4-4bc7-96d4-b1bf1a1428c4', 'e817ada9-7677-4c5e-b443-185cb725dae2', '5716b4fb-39b4-42b9-af76-c972eb243428', 'c0d07a47-a05c-42af-934d-e6517e4bf86e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:38 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:38 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:38 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info is being set with open permissions: ugo+rw
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:38 devstack sudo[100340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info
Sep 04 06:04:38 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:38 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Deleted volume successfully.
Sep 04 06:04:38 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.info" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ddea6e0-cddc-4e02-b9b6-3ffc3f9cc325 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-4a6eddc5-6c24-435c-9058-5d46a3ed7edf-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] snapshot: 97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5, volume: 17d8ed30-e61a-4021-b460-1f67cf02a7d6,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af8b0d-a886-4e73-82d8-6020eafd17ac]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:39 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:39 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Flow 'volume_create_manager' (7444decc-e3a1-4d40-acc4-30d031041500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9f3b4-19b6-4ea0-9cbb-c177dde65e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab9f3b4-19b6-4ea0-9cbb-c177dde65e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1803832609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175532e2-eacf-4fdf-83f3-e056c8536c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c7d126d684ab4af995f6f2a439aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:39Z,use_quota=True,user_id='4cbf7eba306c451a97582487ddb4a20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e58456a-207c-45a0-b761-0ac6bfd21997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e58456a-207c-45a0-b761-0ac6bfd21997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a9463f-07cd-44c0-a4d6-28f1bf69c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70a9463f-07cd-44c0-a4d6-28f1bf69c456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175532e2-eacf-4fdf-83f3-e056c8536c60', 'volume_name': 'volume-175532e2-eacf-4fdf-83f3-e056c8536c60', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38c8d6a-dd9b-48f2-b7c5-b41e0a02f982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38c8d6a-dd9b-48f2-b7c5-b41e0a02f982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e44c9b-f20a-45db-bee9-8519c8136228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Volume 175532e2-eacf-4fdf-83f3-e056c8536c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175532e2-eacf-4fdf-83f3-e056c8536c60', 'volume_size': 1}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:39 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.427s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b77091-6e26-44c3-866d-e14e5545d730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010eb16-5f58-47ec-b826-5f195ba805a5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:39 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:39 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:39 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:04:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:39 devstack sudo[100357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6
Sep 04 06:04:39 devstack sudo[100357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:45 devstack sudo[100357]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6" returned: 0 in 6.137s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:45 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:04:45 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Converted 1024.00 MB image at 166.83 MB/s
Sep 04 06:04:45 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 is being set with open permissions: ugo+rw
Sep 04 06:04:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:45 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6
Sep 04 06:04:45 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:46 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" released by "_copy_volume_from_snapshot" :: held 7.426s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-quobyte-97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Deleting offline snapshot 97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 of volume a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] snapshot_file for this snap is: volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[363ec9aa-8bcc-4942-836d-48d7a1f564aa]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:46 devstack sudo[100380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:46 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-3c9d13b3-1bfb-46f3-a6a2-d6434bca12e4 req-edf94b96-fc83-4f78-b9f9-b8d13076d810 tempest-TestMinimumBasicScenario-359047127 None] Terminate volume connection completed successfully.
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-3c9d13b3-1bfb-46f3-a6a2-d6434bca12e4 req-edf94b96-fc83-4f78-b9f9-b8d13076d810 tempest-TestMinimumBasicScenario-359047127 None] Deleting attachment d8504d44-a873-4fb9-b5d0-e9113f29df3b. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:04:46 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.507s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8b77091-6e26-44c3-866d-e14e5545d730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[813f6311-12ee-4ecd-b0b6-ac4059076e48]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:47 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:47 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "cinder-2da4a194-c7e6-4603-94be-b3b82a3a6e5f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "cinder-2da4a194-c7e6-4603-94be-b3b82a3a6e5f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "cinder-quobyte-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "cinder-quobyte-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba9db5-270a-430c-849e-a736e0f39f55]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:47 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.662s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:47 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:47 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:47 devstack sudo[100400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f
Sep 04 06:04:47 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:47 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:48 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f
Sep 04 06:04:48 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:48 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.465s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:48 devstack sudo[100413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5
Sep 04 06:04:48 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:48 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "cinder-quobyte-2da4a194-c7e6-4603-94be-b3b82a3a6e5f" released by "delete_volume" :: held 0.765s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Created reservations ['50b33167-42a9-482f-aefa-754bef4f39e2', '45dcf25f-802c-47a6-900c-02207a414c2e', '878bdf24-68d1-430f-9f0b-8659deaaf036', '48db25c2-368a-477c-95d7-0cef1bc549b7'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:48 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730.97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" returned: 0 in 0.349s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-97d21fbc-b7b2-4e56-94e9-6c6f52de0eb5" released by "_delete_snapshot" :: held 2.151s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:48 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:48 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.916s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.243s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1803832609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175532e2-eacf-4fdf-83f3-e056c8536c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff2c7d126d684ab4af995f6f2a439aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:39Z,use_quota=True,user_id='4cbf7eba306c451a97582487ddb4a20a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Creating volume 175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:48 devstack sudo[100419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 1073741824
Sep 04 06:04:48 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ca7907-cccb-4d3b-8806-8100288afca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6', 'volume_size': 2, 'source_volid': 'a8b77091-6e26-44c3-866d-e14e5545d730', 'source_volstatus': 'available'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27bd2ae-620c-47ad-afff-0c0d8845eb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Volume volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 (17d8ed30-e61a-4021-b460-1f67cf02a7d6): created successfully
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b27bd2ae-620c-47ad-afff-0c0d8845eb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Flow 'volume_create_manager' (90758bd9-9851-42ca-962e-5279115cf98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-db5d57d7-88bd-462f-9ce3-4de9553dbecb tempest-VolumesCloneTest-2010496983 None] Created volume successfully.
Sep 04 06:04:48 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Deleted volume successfully.
Sep 04 06:04:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53ad2dd7-e359-451c-a147-e14f320f69a1 tempest-TestMinimumBasicScenario-359047127 None] Lock "cinder-2da4a194-c7e6-4603-94be-b3b82a3a6e5f-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:49 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 1073741824" returned: 0 in 0.871s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:49 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:04:49 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-17d8ed30-e61a-4021-b460-1f67cf02a7d6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-17d8ed30-e61a-4021-b460-1f67cf02a7d6-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0e503-4845-4cda-a41b-5bd8640f334f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:50 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.521s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59e44c9b-f20a-45db-bee9-8519c8136228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175532e2-eacf-4fdf-83f3-e056c8536c60', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9e2086-0386-423b-97bc-95ed9246775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Volume volume-175532e2-eacf-4fdf-83f3-e056c8536c60 (175532e2-eacf-4fdf-83f3-e056c8536c60): created successfully
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9e2086-0386-423b-97bc-95ed9246775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Flow 'volume_create_manager' (7444decc-e3a1-4d40-acc4-30d031041500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6847086b-47f1-4450-a9b6-66e03ef157d3 tempest-VolumesExtendTest-1638110505 None] Created volume successfully.
Sep 04 06:04:50 devstack sudo[100449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6
Sep 04 06:04:50 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:50 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6" returned: 0 in 0.697s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:50 devstack sudo[100457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6
Sep 04 06:04:50 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:51 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-17d8ed30-e61a-4021-b460-1f67cf02a7d6" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-17d8ed30-e61a-4021-b460-1f67cf02a7d6" released by "delete_volume" :: held 1.167s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Created reservations ['6e8d76bb-cb2c-467f-bbdc-e88030169bc4', 'f134d152-6149-459d-b488-b6bef24fb493', 'e5362f1d-ceb6-4141-96a5-9cb7a76b17e8', '6ddebe3f-94e3-4b38-b0a4-ea98ffb9503d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:51 devstack sudo[100460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:51 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:51 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Creating offline snapshot ecd187b5-a6e5-4db0-bc60-a5824b72f60b of volume 175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:04:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Deleted volume successfully.
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[270e48ca-2ed8-4a89-8f50-d256e99b764e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bc92444-6eaa-4ba9-b317-102554883048 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-17d8ed30-e61a-4021-b460-1f67cf02a7d6-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:51 devstack sudo[100463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:04:51 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-a8b77091-6e26-44c3-866d-e14e5545d730-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:52 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.600s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-a8b77091-6e26-44c3-866d-e14e5545d730-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:52 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b 1G
Sep 04 06:04:52 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "cinder-quobyte-a8b77091-6e26-44c3-866d-e14e5545d730" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-a8b77091-6e26-44c3-866d-e14e5545d730" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9edc988-eab9-4584-b49a-52cc3ddab913]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:52 devstack sudo[100470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:52 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Flow 'volume_create_manager' (b71bd75f-7848-4365-891e-6ae8a9e273fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826dd161-d5a3-4418-a89d-484b2aa2ce37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (826dd161-d5a3-4418-a89d-484b2aa2ce37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1654789648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc43541-37f0-41b1-aadd-7d78f28f4140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb1bfd40d6a4defb01a519d4b256ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:53Z,use_quota=True,user_id='bf73a65d58be48cda1c9d361a67db287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6190b1-d895-48f6-b809-7bffc45840fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6190b1-d895-48f6-b809-7bffc45840fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9ca0fd-96a1-41e5-8e04-7fdaeddc97a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:52 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a9ca0fd-96a1-41e5-8e04-7fdaeddc97a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc43541-37f0-41b1-aadd-7d78f28f4140', 'volume_name': 'volume-9cc43541-37f0-41b1-aadd-7d78f28f4140', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bac1715-7b81-4d12-82cf-eb41bf0ec31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bac1715-7b81-4d12-82cf-eb41bf0ec31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31945ab0-5754-4b86-9d33-7a2410cad77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume 9cc43541-37f0-41b1-aadd-7d78f28f4140: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc43541-37f0-41b1-aadd-7d78f28f4140', 'volume_size': 1}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:52 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b 1G" returned: 0 in 0.687s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175532e2-eacf-4fdf-83f3-e056c8536c60 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.510s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:52 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175532e2-eacf-4fdf-83f3-e056c8536c60 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b
Sep 04 06:04:53 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:53 devstack sudo[100481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730
Sep 04 06:04:53 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:53 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a8b77091-6e26-44c3-866d-e14e5545d730" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-quobyte-a8b77091-6e26-44c3-866d-e14e5545d730" released by "delete_volume" :: held 0.849s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=127,cinder:INSERT=46,cinder:UPDATE=179,cinder:DELETE=13 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:INSERT=42,cinder:UPDATE=167,cinder:SELECT=140,cinder:DELETE=12 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:04:53 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175532e2-eacf-4fdf-83f3-e056c8536c60 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:53 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b is being set with open permissions: ugo+rw
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Created reservations ['bd3a6f77-7ebc-4d08-87c2-08cffa57be92', 'a5ef45aa-9eaa-44f2-a933-af4a005857fa', 'cbd98346-157c-4100-8189-5e2566488068', '8b0ddbee-0929-40e5-a495-d98d0e30a573'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:53 devstack sudo[100488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b
Sep 04 06:04:53 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:53 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:53 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:53 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:53 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info
Sep 04 06:04:53 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:53 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Deleted volume successfully.
Sep 04 06:04:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-79bb96dc-fce1-47d8-8d96-80ec80f6b834 tempest-VolumesCloneTest-2010496983 None] Lock "cinder-a8b77091-6e26-44c3-866d-e14e5545d730-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:54 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:54 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info is being set with open permissions: ugo+rw
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:54 devstack sudo[100497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info
Sep 04 06:04:54 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:54 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.info" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.415s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1654789648',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc43541-37f0-41b1-aadd-7d78f28f4140,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb1bfd40d6a4defb01a519d4b256ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:53Z,use_quota=True,user_id='bf73a65d58be48cda1c9d361a67db287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Creating volume 9cc43541-37f0-41b1-aadd-7d78f28f4140 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:54 devstack sudo[100501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 1073741824
Sep 04 06:04:54 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0bf21770-9d2d-4b87-953e-c89034ace897 tempest-VolumesExtendTest-1638110505 None] Create snapshot completed successfully
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:55 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 1073741824" returned: 0 in 0.760s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:55 devstack sudo[100507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140
Sep 04 06:04:55 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:55 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.495s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31945ab0-5754-4b86-9d33-7a2410cad77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc43541-37f0-41b1-aadd-7d78f28f4140', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3376332d-9c42-4fe1-943d-08cfcbb88bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f53cabd-f29b-49f7-a54c-dd8b940bfa09]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 (9cc43541-37f0-41b1-aadd-7d78f28f4140): created successfully
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3376332d-9c42-4fe1-943d-08cfcbb88bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Flow 'volume_create_manager' (b71bd75f-7848-4365-891e-6ae8a9e273fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dfeb076c-6b9b-4001-8c93-01b51bfa51b6 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Created volume successfully.
Sep 04 06:04:55 devstack sudo[100510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:04:55 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:56 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.552s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "cinder-9cc43541-37f0-41b1-aadd-7d78f28f4140-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "cinder-9cc43541-37f0-41b1-aadd-7d78f28f4140-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "cinder-quobyte-9cc43541-37f0-41b1-aadd-7d78f28f4140" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "cinder-quobyte-9cc43541-37f0-41b1-aadd-7d78f28f4140" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64059156-99a5-4aa6-877e-bbcfa93ade6e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b 2G" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.912s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c84ae09d-51a1-4920-aceb-0db8370f22fa tempest-VolumesExtendTest-1638110505 None] Extend volume completed successfully.
Sep 04 06:04:56 devstack sudo[100520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140
Sep 04 06:04:56 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:56 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140" returned: 0 in 0.463s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:56 devstack sudo[100525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140
Sep 04 06:04:56 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:57 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9cc43541-37f0-41b1-aadd-7d78f28f4140" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "cinder-quobyte-9cc43541-37f0-41b1-aadd-7d78f28f4140" released by "delete_volume" :: held 0.832s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Created reservations ['62528e5b-730f-418e-8648-27120c7c63ad', '6f1e6660-282c-410b-b9a8-2dc09ec0dba6', '94313781-3da4-4037-8de8-67cd481abe4d', '81a1d300-7114-48f0-94bd-74301ddc62ca'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:57 devstack sudo[100528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:04:57 devstack sudo[100528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-ecd187b5-a6e5-4db0-bc60-a5824b72f60b-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-ecd187b5-a6e5-4db0-bc60-a5824b72f60b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-quobyte-ecd187b5-a6e5-4db0-bc60-a5824b72f60b" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-ecd187b5-a6e5-4db0-bc60-a5824b72f60b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Deleting offline snapshot ecd187b5-a6e5-4db0-bc60-a5824b72f60b of volume 175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] snapshot_file for this snap is: volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4bceb-8da9-4dc9-aa3a-56d5674872fd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:57 devstack sudo[100528]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:04:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Deleted volume successfully.
Sep 04 06:04:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6f2203a8-4baf-4a4a-9c78-b5dce837d313 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "cinder-9cc43541-37f0-41b1-aadd-7d78f28f4140-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:57 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b
Sep 04 06:04:57 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:58 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b" returned: 0 in 0.514s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-175532e2-eacf-4fdf-83f3-e056c8536c60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c595264-7eb2-4281-a1ec-e269d518f630]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Flow 'volume_create_manager' (ab8acad5-a4ef-4c9c-b5cf-bc0c1a6a5776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f31edbd-7659-4d77-99b9-82116e7f9866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f31edbd-7659-4d77-99b9-82116e7f9866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1979075314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8a506f-3cf3-4b8a-a5c0-a90612dbf096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb1bfd40d6a4defb01a519d4b256ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:58Z,use_quota=True,user_id='bf73a65d58be48cda1c9d361a67db287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack sudo[100538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:04:58 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f091b2e6-fbcc-42f8-8d22-20cab476166e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f091b2e6-fbcc-42f8-8d22-20cab476166e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b804a47-cdf1-4142-b7cf-c2ab92d3ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b804a47-cdf1-4142-b7cf-c2ab92d3ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f8a506f-3cf3-4b8a-a5c0-a90612dbf096', 'volume_name': 'volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d930e76-b6af-40d2-acb7-86ae4cdaf9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d930e76-b6af-40d2-acb7-86ae4cdaf9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66eff26-12d2-44a3-a761-7eaef311c12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume 4f8a506f-3cf3-4b8a-a5c0-a90612dbf096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096', 'volume_size': 1}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1979075314',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f8a506f-3cf3-4b8a-a5c0-a90612dbf096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3eb1bfd40d6a4defb01a519d4b256ec2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:58Z,use_quota=True,user_id='bf73a65d58be48cda1c9d361a67db287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Creating volume 4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:58 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:58 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 1073741824
Sep 04 06:04:58 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Flow 'volume_create_manager' (5c9793ca-72fc-4e84-a11f-4dd3012eabdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb5abc8-2e80-432c-8f89-75e47ab07cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb5abc8-2e80-432c-8f89-75e47ab07cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-407839997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88224119-9fe4-4ab9-9fca-c2fe78a20126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244fdc082004396bcf359767e1cc61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:59Z,use_quota=True,user_id='b95c02b31f9347948c10702839747c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda9dec0-9708-42b1-a09c-902a1830c4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda9dec0-9708-42b1-a09c-902a1830c4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d5ab90-7e8b-4000-9229-c4ce831fc386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d5ab90-7e8b-4000-9229-c4ce831fc386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88224119-9fe4-4ab9-9fca-c2fe78a20126', 'volume_name': 'volume-88224119-9fe4-4ab9-9fca-c2fe78a20126', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb12777-b391-46d3-bc09-eb321d85388f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbb12777-b391-46d3-bc09-eb321d85388f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8893ee37-4169-4f2f-b05c-94bb4e56854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Volume 88224119-9fe4-4ab9-9fca-c2fe78a20126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88224119-9fe4-4ab9-9fca-c2fe78a20126', 'volume_size': 2}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:58 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.647s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:59 devstack sudo[100548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b
Sep 04 06:04:59 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:59 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 1073741824" returned: 0 in 0.753s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:59 devstack sudo[100555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096
Sep 04 06:04:59 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:59 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:59 devstack sudo[100557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b
Sep 04 06:04:59 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:59 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-407839997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88224119-9fe4-4ab9-9fca-c2fe78a20126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7244fdc082004396bcf359767e1cc61f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:04:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:04:59Z,use_quota=True,user_id='b95c02b31f9347948c10702839747c25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Creating volume 88224119-9fe4-4ab9-9fca-c2fe78a20126 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:04:59 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 2147483648 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:04:59 devstack sudo[100561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 2147483648
Sep 04 06:04:59 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66eff26-12d2-44a3-a761-7eaef311c12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:59 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75a89cf-3b11-4f28-a924-a16765b2edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60.ecd187b5-a6e5-4db0-bc60-a5824b72f60b" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:04:59 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Volume volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 (4f8a506f-3cf3-4b8a-a5c0-a90612dbf096): created successfully
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c75a89cf-3b11-4f28-a924-a16765b2edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Flow 'volume_create_manager' (ab8acad5-a4ef-4c9c-b5cf-bc0c1a6a5776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:04:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1029604d-c53e-4eda-b37e-0e45594ea080 tempest-VolumeQuotasAdminTestJSON-1183594821 None] Created volume successfully.
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-ecd187b5-a6e5-4db0-bc60-a5824b72f60b" released by "_delete_snapshot" :: held 2.174s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:04:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" released by "delete_snapshot" :: held 2.204s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Created reservations ['9a8f565c-2c0a-42eb-b383-a5af56457a17', 'bbe0ae2e-f3ff-4b5b-ae0f-94037e024b5c', 'e004d28f-7ed8-452f-be17-49cd581321fc', '458ab6c0-deb4-4329-9788-4254060eeaef'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Delete snapshot completed successfully.
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f6d733ef-c3a6-4976-83c4-4651469d038a tempest-VolumesExtendTest-1638110505 None] Lock "cinder-ecd187b5-a6e5-4db0-bc60-a5824b72f60b-delete_snapshot" released by "delete_snapshot" :: held 2.472s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:00 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 2147483648" returned: 0 in 0.661s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:00 devstack sudo[100567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126
Sep 04 06:05:00 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:00 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8893ee37-4169-4f2f-b05c-94bb4e56854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88224119-9fe4-4ab9-9fca-c2fe78a20126', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8947e6f0-6347-4b98-9d3a-1b1b12df0497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Volume volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 (88224119-9fe4-4ab9-9fca-c2fe78a20126): created successfully
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8947e6f0-6347-4b98-9d3a-1b1b12df0497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Flow 'volume_create_manager' (5c9793ca-72fc-4e84-a11f-4dd3012eabdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6bb27829-ea9d-43bd-93b5-95646186740a tempest-VolumesCloneNegativeTest-1550622069 None] Created volume successfully.
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-175532e2-eacf-4fdf-83f3-e056c8536c60-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-175532e2-eacf-4fdf-83f3-e056c8536c60-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd75f1f5-240a-4143-a431-1e587f72d594]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-35ecb33e-0ba4-473f-93ba-0e34cf01bb6b tempest-VolumeQuotasAdminTestJSON-689941915 None] Transfer volume completed successfully.
Sep 04 06:05:01 devstack sudo[100572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:05:01 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:01 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:01 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60
Sep 04 06:05:01 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Acquiring lock "cinder-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "cinder-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Acquiring lock "cinder-quobyte-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "cinder-quobyte-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[294762d5-bc3f-45c7-8595-f7644ac333c4]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:02 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-175532e2-eacf-4fdf-83f3-e056c8536c60" returned: 0 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:02 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096
Sep 04 06:05:02 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Acquiring lock "cinder-88224119-9fe4-4ab9-9fca-c2fe78a20126-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-quobyte-175532e2-eacf-4fdf-83f3-e056c8536c60" released by "delete_volume" :: held 1.112s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "cinder-88224119-9fe4-4ab9-9fca-c2fe78a20126-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Acquiring lock "cinder-quobyte-88224119-9fe4-4ab9-9fca-c2fe78a20126" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Created reservations ['97ab1d49-583e-48d1-b744-002528936c38', '54d018cc-67c0-4547-a53a-6b0c69507108', 'b212f4c9-2f0f-46d1-a260-b073e7909677', '77cfe6df-bd05-458a-91e7-24fd9ca2ad9f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "cinder-quobyte-88224119-9fe4-4ab9-9fca-c2fe78a20126" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4701075-8c3f-49b0-9585-e969148e39cf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:02 devstack sudo[100586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:02 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:02 devstack sudo[100585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126
Sep 04 06:05:02 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:02 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" returned: 0 in 0.581s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:02 devstack sudo[100592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096
Sep 04 06:05:02 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:02 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Deleted volume successfully.
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-18a98a44-a00d-4798-ad71-afd70c279286 tempest-VolumesExtendTest-1638110505 None] Lock "cinder-175532e2-eacf-4fdf-83f3-e056c8536c60-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:02 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:02 devstack sudo[100598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126
Sep 04 06:05:02 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:02 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "cinder-quobyte-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096" released by "delete_volume" :: held 0.931s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Created reservations ['0fd9bcfc-5ed0-470e-8660-a7d433487606', 'dd58191c-547b-43ee-addd-0ca978fafb97', 'f49202c4-ba2d-4128-8401-96f222ea562a', '48089ee9-7b6c-4287-9017-1602fe5fba3b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:03 devstack sudo[100601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:03 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:03 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-88224119-9fe4-4ab9-9fca-c2fe78a20126" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "cinder-quobyte-88224119-9fe4-4ab9-9fca-c2fe78a20126" released by "delete_volume" :: held 0.839s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Created reservations ['107536b4-79b0-4d13-8273-8d84f290fefb', '78cd0bfc-d443-4b59-a505-3e2a67e8d724', 'dec5a918-44de-49e7-9047-2f066398fd80', '3567faf6-f61a-4f16-89f9-d9aca68e9b3e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:03 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:03 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:03 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Deleted volume successfully.
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-53080d69-b95e-46ad-9676-904ef95704a7 tempest-VolumeQuotasAdminTestJSON-732024195 None] Lock "cinder-4f8a506f-3cf3-4b8a-a5c0-a90612dbf096-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:03 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.411s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:03 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Deleted volume successfully.
Sep 04 06:05:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-82c17b46-933e-46d6-a866-e1610c7cca68 tempest-VolumesCloneNegativeTest-1550622069 None] Lock "cinder-88224119-9fe4-4ab9-9fca-c2fe78a20126-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Flow 'volume_create_manager' (7e3a43f6-b336-4c76-89a8-c5879abcdefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8457ce-1fc2-4c51-b84e-be1e2673a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8457ce-1fc2-4c51-b84e-be1e2673a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1640520754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97da783-73f1-497e-b95f-7182abb96bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9e68267da84f11b247722f7ab85b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:10Z,use_quota=True,user_id='e7e4383481bf4752822d1a1488191860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292d86c0-c760-44a2-9bc6-babc705df241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292d86c0-c760-44a2-9bc6-babc705df241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d61fb-43b6-44f5-883d-5b033296b187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d61fb-43b6-44f5-883d-5b033296b187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd97da783-73f1-497e-b95f-7182abb96bfe', 'volume_name': 'volume-d97da783-73f1-497e-b95f-7182abb96bfe', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c10c9c-8b46-4529-847c-5419402552b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c10c9c-8b46-4529-847c-5419402552b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed2446-cd3e-4053-92cb-3bb4b3e4dd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Volume d97da783-73f1-497e-b95f-7182abb96bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d97da783-73f1-497e-b95f-7182abb96bfe', 'volume_size': 1}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1640520754',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d97da783-73f1-497e-b95f-7182abb96bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a9e68267da84f11b247722f7ab85b34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:10Z,use_quota=True,user_id='e7e4383481bf4752822d1a1488191860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Creating volume d97da783-73f1-497e-b95f-7182abb96bfe {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:05:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:05:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:09 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe 1073741824
Sep 04 06:05:09 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:10 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe 1073741824" returned: 0 in 0.606s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:10 devstack sudo[100615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe
Sep 04 06:05:10 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:10 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ed2446-cd3e-4053-92cb-3bb4b3e4dd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97da783-73f1-497e-b95f-7182abb96bfe', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62791700-4f98-4809-a8ff-7e24683eaa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Volume volume-d97da783-73f1-497e-b95f-7182abb96bfe (d97da783-73f1-497e-b95f-7182abb96bfe): created successfully
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62791700-4f98-4809-a8ff-7e24683eaa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Flow 'volume_create_manager' (7e3a43f6-b336-4c76-89a8-c5879abcdefe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-aac2a6ed-9cdf-425d-91af-43a0af4aaf6d tempest-VolumesNegativeTest-400462629 None] Created volume successfully.
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:12 devstack sudo[100621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:12 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:13 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Flow 'volume_create_manager' (00c1e459-3ed7-4b12-90fb-97301a7ee182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f31056-a452-4866-8bee-5b9f3489bbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f31056-a452-4866-8bee-5b9f3489bbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-514469059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e984ebcc-e5b3-4700-ba60-d888e1b62e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78eb17012abc416a8b5fecc4c55a8198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:13Z,use_quota=True,user_id='dddddff5c0f04d1a824aac66030df209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0fe51e-c389-49aa-a8c7-6f951c7648a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0fe51e-c389-49aa-a8c7-6f951c7648a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9794c53-edb4-4324-866b-d4d7489f8f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9794c53-edb4-4324-866b-d4d7489f8f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e984ebcc-e5b3-4700-ba60-d888e1b62e26', 'volume_name': 'volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099aa36c-49d2-49ff-8790-9754ea69b7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099aa36c-49d2-49ff-8790-9754ea69b7bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6efc1c-389f-46b5-ac73-90112184db51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Volume e984ebcc-e5b3-4700-ba60-d888e1b62e26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26', 'volume_size': 1}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-514469059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e984ebcc-e5b3-4700-ba60-d888e1b62e26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78eb17012abc416a8b5fecc4c55a8198',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:13Z,use_quota=True,user_id='dddddff5c0f04d1a824aac66030df209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Creating volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:05:13 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:13 devstack sudo[100627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 1073741824
Sep 04 06:05:13 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:13 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 1073741824" returned: 0 in 0.563s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:14 devstack sudo[100633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26
Sep 04 06:05:14 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:14 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee6efc1c-389f-46b5-ac73-90112184db51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d692a53-2f65-45aa-8a37-ca424e48f75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Volume volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 (e984ebcc-e5b3-4700-ba60-d888e1b62e26): created successfully
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d692a53-2f65-45aa-8a37-ca424e48f75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Flow 'volume_create_manager' (00c1e459-3ed7-4b12-90fb-97301a7ee182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:14 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-18eae332-c1af-481b-9b6f-bab4898f351e tempest-VolumesSnapshotListTestJSON-971586510 None] Created volume successfully.
Sep 04 06:05:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Creating offline snapshot eaecebbe-22e0-46c8-80a5-d74da5e5e036 of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:05:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5742b10-0441-4b65-9858-fa2900db53c0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:15 devstack sudo[100649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26
Sep 04 06:05:15 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:16 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:16 devstack sudo[100657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 1G
Sep 04 06:05:16 devstack sudo[100657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:16 devstack sudo[100657]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 1G" returned: 0 in 0.584s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:16 devstack sudo[100665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:16 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:17 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:17 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 is being set with open permissions: ugo+rw
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:17 devstack sudo[100670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:17 devstack sudo[100670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:17 devstack sudo[100670]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.324s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:17 devstack sudo[100673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info
Sep 04 06:05:17 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:17 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:17 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info is being set with open permissions: ugo+rw
Sep 04 06:05:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:17 devstack sudo[100676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info
Sep 04 06:05:17 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:18 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.info" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c6dd9f9f-a94b-48b5-b933-6131b34220b5 tempest-VolumesSnapshotListTestJSON-971586510 None] Create snapshot completed successfully
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Creating offline snapshot a26b8dd7-339a-40dd-a045-5184e842428a of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadcef71-aaca-49f0-a0e6-ca49612141c5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:19 devstack sudo[100680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:19 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:19 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.520s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:19 devstack sudo[100694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a 1G
Sep 04 06:05:19 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:21 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a 1G" returned: 0 in 1.167s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:21 devstack sudo[100755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:21 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:21 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.587s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:21 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a is being set with open permissions: ugo+rw
Sep 04 06:05:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:21 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:21 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:22 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.525s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.047s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7102c6c3-391b-4455-bc1a-bc30c0a0aef3 tempest-VolumesSnapshotListTestJSON-971586510 None] Create snapshot completed successfully
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Creating offline snapshot 3fea8d10-279b-452e-b6da-ce84190f84ac of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58ba3e-1926-47df-baed-6831c600af57]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:23 devstack sudo[100769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:23 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:23 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.578s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:23 devstack sudo[100774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac 1G
Sep 04 06:05:23 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:24 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac 1G" returned: 0 in 0.930s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:24 devstack sudo[100780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac
Sep 04 06:05:24 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:25 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac" returned: 0 in 0.561s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:25 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac is being set with open permissions: ugo+rw
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:25 devstack sudo[100790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac
Sep 04 06:05:25 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:25 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.849s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Flow 'volume_create_manager' (f90c9510-bb98-4171-a005-c340864ce2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1947a908-14d7-4e9a-b3cc-789906f2d9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1947a908-14d7-4e9a-b3cc-789906f2d9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1036028202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66926dd-cbee-4936-97fc-0eaf6e74dd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f88fb871d1482c85aa1cefc338c701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:26Z,use_quota=True,user_id='fab166de3d854da293c713cd3af731d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c974f367-06cc-4ff5-acf0-ec453fcad9f6),volume_type_id=c974f367-06cc-4ff5-acf0-ec453fcad9f6)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc46edf7-2b00-4e39-b6ba-ce18e0b87a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc46edf7-2b00-4e39-b6ba-ce18e0b87a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70463c6-a99b-4216-8bf0-afcf9042c3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70463c6-a99b-4216-8bf0-afcf9042c3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66926dd-cbee-4936-97fc-0eaf6e74dd8a', 'volume_name': 'volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73d796b-8cf6-4969-9383-6b5e4154c25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73d796b-8cf6-4969-9383-6b5e4154c25b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787ea240-fb9b-4a87-b485-9191ab53e786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Volume c66926dd-cbee-4936-97fc-0eaf6e74dd8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a', 'volume_size': 1}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1036028202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66926dd-cbee-4936-97fc-0eaf6e74dd8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69f88fb871d1482c85aa1cefc338c701',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:26Z,use_quota=True,user_id='fab166de3d854da293c713cd3af731d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c974f367-06cc-4ff5-acf0-ec453fcad9f6),volume_type_id=c974f367-06cc-4ff5-acf0-ec453fcad9f6)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Creating volume c66926dd-cbee-4936-97fc-0eaf6e74dd8a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:05:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:05:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-156af377-34e9-418f-980b-71e76c1c008c tempest-VolumesSnapshotListTestJSON-971586510 None] Create snapshot completed successfully
Sep 04 06:05:25 devstack sudo[100809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a 1073741824
Sep 04 06:05:25 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:26 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a 1073741824" returned: 0 in 0.953s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:26 devstack sudo[100818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a
Sep 04 06:05:26 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-3fea8d10-279b-452e-b6da-ce84190f84ac-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:27 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" returned: 0 in 0.355s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-3fea8d10-279b-452e-b6da-ce84190f84ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (787ea240-fb9b-4a87-b485-9191ab53e786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c0633a-d4bd-434e-9a7c-07dddd097bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-3fea8d10-279b-452e-b6da-ce84190f84ac" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Volume volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a (c66926dd-cbee-4936-97fc-0eaf6e74dd8a): created successfully
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52c0633a-d4bd-434e-9a7c-07dddd097bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Flow 'volume_create_manager' (f90c9510-bb98-4171-a005-c340864ce2bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3192cb09-2033-4e61-b51c-f04da2fc4065 tempest-VolumeTypesAccessTest-1169225844 None] Created volume successfully.
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-3fea8d10-279b-452e-b6da-ce84190f84ac" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Deleting offline snapshot 3fea8d10-279b-452e-b6da-ce84190f84ac of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] snapshot_file for this snap is: volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c846887-e206-45e4-922f-a2e5ac942647]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:27 devstack sudo[100821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac
Sep 04 06:05:27 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:27 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac" returned: 0 in 0.577s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d0bc3-be36-43bc-b52d-1b3d633669fb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Acquiring lock "cinder-c66926dd-cbee-4936-97fc-0eaf6e74dd8a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "cinder-c66926dd-cbee-4936-97fc-0eaf6e74dd8a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Acquiring lock "cinder-quobyte-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:28 devstack sudo[100828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:28 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "cinder-quobyte-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c8ac89-ba42-4fe6-b902-12cde075df52]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:28 devstack sudo[100830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a
Sep 04 06:05:28 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:28 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.566s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:28 devstack sudo[100835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac
Sep 04 06:05:28 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:28 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:28 devstack sudo[100840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a
Sep 04 06:05:28 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:29 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" returned: 0 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "cinder-quobyte-c66926dd-cbee-4936-97fc-0eaf6e74dd8a" released by "delete_volume" :: held 0.899s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:29 devstack cinder-volume[87095]: WARNING cinder.quota [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1979927623 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1979927623, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:05:29 devstack cinder-volume[87095]: WARNING cinder.quota [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1979927623 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1979927623, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:05:29 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Created reservations ['08ed9a60-ca85-4d66-87cb-d958812d129f', '7cb25347-6d96-4364-a481-50f456bb0625', '3f79dcaf-2c45-4dc6-b902-d82365524916', '816d0e24-bbef-43dd-963b-91d904ff2823'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac" returned: 0 in 0.551s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:29 devstack sudo[100847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac
Sep 04 06:05:29 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:29 devstack sudo[100849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:29 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:29 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Deleted volume successfully.
Sep 04 06:05:29 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.3fea8d10-279b-452e-b6da-ce84190f84ac" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-3fea8d10-279b-452e-b6da-ce84190f84ac" released by "_delete_snapshot" :: held 2.258s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8e6b73b6-fb5d-4265-8c80-38c9b00f303c tempest-VolumeTypesAccessTest-1169225844 None] Lock "cinder-c66926dd-cbee-4936-97fc-0eaf6e74dd8a-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" released by "delete_snapshot" :: held 2.310s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Created reservations ['89426b15-fb68-447b-bb4a-46435feb6490', '84c87b53-9c97-4f3f-891c-9c4d133bca5d', '9cb98934-78f1-4d61-8913-d3948d762b05', 'ff5f94b7-8708-4dc4-a055-b11e1690dc0f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Delete snapshot completed successfully.
Sep 04 06:05:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fe6b56f7-7dae-4b5d-a8e6-df6de20e1338 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-3fea8d10-279b-452e-b6da-ce84190f84ac-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-a26b8dd7-339a-40dd-a045-5184e842428a-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-a26b8dd7-339a-40dd-a045-5184e842428a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-a26b8dd7-339a-40dd-a045-5184e842428a" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-a26b8dd7-339a-40dd-a045-5184e842428a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Deleting offline snapshot a26b8dd7-339a-40dd-a045-5184e842428a of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] snapshot_file for this snap is: volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[437747f7-5ed0-48b4-bdf9-f024abcccaa1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:30 devstack sudo[100854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:30 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:31 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.552s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a281acd-d01e-4228-84b3-c62d53537804]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:31 devstack sudo[100859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:31 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:31 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.518s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:31 devstack sudo[100865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:31 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:32 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.541s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:32 devstack sudo[100872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a
Sep 04 06:05:32 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:32 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.a26b8dd7-339a-40dd-a045-5184e842428a" returned: 0 in 0.366s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-a26b8dd7-339a-40dd-a045-5184e842428a" released by "_delete_snapshot" :: held 2.123s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" released by "delete_snapshot" :: held 2.155s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Created reservations ['971b9476-49c9-452e-942d-eb5a40269ebe', '26ad21a8-5928-4765-a286-8453c8bed72b', 'bab0613b-da40-4232-bd0e-7e3b2647a84c', '2d9767bc-afbd-481f-989c-44fe8dcd360c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Delete snapshot completed successfully.
Sep 04 06:05:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9c1ec6f-0cbb-4372-9684-b91edaabdbee tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-a26b8dd7-339a-40dd-a045-5184e842428a-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-eaecebbe-22e0-46c8-80a5-d74da5e5e036-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-eaecebbe-22e0-46c8-80a5-d74da5e5e036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-eaecebbe-22e0-46c8-80a5-d74da5e5e036" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-eaecebbe-22e0-46c8-80a5-d74da5e5e036" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Deleting offline snapshot eaecebbe-22e0-46c8-80a5-d74da5e5e036 of volume e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] snapshot_file for this snap is: volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de24639-4ae7-481e-87b7-88246ddb1482]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:34 devstack sudo[100912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:34 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:34 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.539s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[22890b33-3008-4b0c-ae08-1baec8706a72]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:34 devstack sudo[100917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26
Sep 04 06:05:34 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:35 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:35 devstack sudo[100923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:35 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:35 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:35 devstack sudo[100928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036
Sep 04 06:05:35 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:35 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26.eaecebbe-22e0-46c8-80a5-d74da5e5e036" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-eaecebbe-22e0-46c8-80a5-d74da5e5e036" released by "_delete_snapshot" :: held 2.035s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" released by "delete_snapshot" :: held 2.072s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Created reservations ['658b9e04-203f-40f6-a5ea-249c37130a01', 'e8fc4cf9-aaf4-4c09-83c4-8d10192e973f', 'ea28640f-764f-4edf-891d-0ab607d26fba', '6484ce5f-f726-4399-982a-ca0cc8829ec8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Delete snapshot completed successfully.
Sep 04 06:05:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-746ea9a6-d4b5-4aa5-b16a-8edfd8c47851 tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-eaecebbe-22e0-46c8-80a5-d74da5e5e036-delete_snapshot" released by "delete_snapshot" :: held 2.286s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-e984ebcc-e5b3-4700-ba60-d888e1b62e26-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-e984ebcc-e5b3-4700-ba60-d888e1b62e26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Acquiring lock "cinder-d97da783-73f1-497e-b95f-7182abb96bfe-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a4a27-852a-4726-a3be-0bc5cc0003ab]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "cinder-d97da783-73f1-497e-b95f-7182abb96bfe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Acquiring lock "cinder-quobyte-d97da783-73f1-497e-b95f-7182abb96bfe" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "cinder-quobyte-d97da783-73f1-497e-b95f-7182abb96bfe" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc4c3b2-9b28-4778-abfd-cc24aedeaaed]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:37 devstack sudo[100931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26
Sep 04 06:05:37 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:37 devstack sudo[100933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe
Sep 04 06:05:37 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:37 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26" returned: 0 in 0.542s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:38 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:38 devstack sudo[100942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26
Sep 04 06:05:38 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:38 devstack sudo[100943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe
Sep 04 06:05:38 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:38 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e984ebcc-e5b3-4700-ba60-d888e1b62e26" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-quobyte-e984ebcc-e5b3-4700-ba60-d888e1b62e26" released by "delete_volume" :: held 0.952s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Created reservations ['0e3fe454-516a-4fbc-a9b4-d7f4f830ce52', '01e259d6-5c89-4bd7-9499-5159ddb1eb14', '0186d484-2a78-4a73-8d02-e9f5a1c5839b', 'e5eec5e6-be1b-4afe-9de7-42e4c1ffc895'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:38 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d97da783-73f1-497e-b95f-7182abb96bfe" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "cinder-quobyte-d97da783-73f1-497e-b95f-7182abb96bfe" released by "delete_volume" :: held 0.948s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:38 devstack sudo[100948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:38 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Created reservations ['55f92679-4d34-47a1-a6c4-482b1d1e0ce3', '951cd939-e32a-4121-87e6-ba5f03a5fa92', 'f6ab907f-f8d1-4d3a-ae80-aa6e9ab9a8b9', 'b32b5e04-739c-4ff8-b275-bac44262dbd8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:38 devstack sudo[100950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:38 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:39 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Deleted volume successfully.
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cc39b8f1-149a-461b-9607-ea07a5ff113a tempest-VolumesSnapshotListTestJSON-971586510 None] Lock "cinder-e984ebcc-e5b3-4700-ba60-d888e1b62e26-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:39 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.483s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Deleted volume successfully.
Sep 04 06:05:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-54ecd746-28d0-4dcf-9ca7-a2d6b270680f tempest-VolumesNegativeTest-400462629 None] Lock "cinder-d97da783-73f1-497e-b95f-7182abb96bfe-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Flow 'volume_create_manager' (09ae2280-f6b5-43ef-8d6f-6b034ede3b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff21086-8e68-4c83-a768-2be81c79e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff21086-8e68-4c83-a768-2be81c79e84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1108614799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e791e2-64a0-4573-a9c8-ff6684496f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1ed42de24e442fa70a6f076cbc3545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:45Z,use_quota=True,user_id='6c9c4619904247fea7ba5937d689ddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e909722-c2b6-4acf-89ee-b6b9d05b45f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e909722-c2b6-4acf-89ee-b6b9d05b45f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0796bb8-f3b0-44b1-b3b2-a479b19d6f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0796bb8-f3b0-44b1-b3b2-a479b19d6f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e791e2-64a0-4573-a9c8-ff6684496f32', 'volume_name': 'volume-58e791e2-64a0-4573-a9c8-ff6684496f32', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bf86a2-891c-4aba-a99e-d4ed4a394926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bf86a2-891c-4aba-a99e-d4ed4a394926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc51d9a-db1f-4f9a-8067-e4030f59c258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Volume 58e791e2-64a0-4573-a9c8-ff6684496f32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e791e2-64a0-4573-a9c8-ff6684496f32', 'volume_size': 2}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1108614799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e791e2-64a0-4573-a9c8-ff6684496f32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e1ed42de24e442fa70a6f076cbc3545',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:45Z,use_quota=True,user_id='6c9c4619904247fea7ba5937d689ddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Creating volume 58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:05:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:05:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 2147483648 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:45 devstack sudo[100956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 2147483648
Sep 04 06:05:45 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:46 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 2147483648" returned: 0 in 0.776s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:05:46 devstack sudo[100962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32
Sep 04 06:05:46 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Flow 'volume_create_manager' (6c9bf0bb-2f6a-486c-8e16-124b17fa7faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea3e2d8-c216-400a-b167-776d68a488f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ea3e2d8-c216-400a-b167-776d68a488f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-799511092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb41ea03-1331-49e2-8c51-37d9a91c8109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e8da55b11c453a91a2a268522dc366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:46Z,use_quota=True,user_id='5cc0e3efa7964794a05571ad41349e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4d6c61-5758-44e9-bf7a-f82bc60c1122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc4d6c61-5758-44e9-bf7a-f82bc60c1122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0d4e7f-08f3-4134-90ba-a9a2208bac0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b0d4e7f-08f3-4134-90ba-a9a2208bac0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb41ea03-1331-49e2-8c51-37d9a91c8109', 'volume_name': 'volume-fb41ea03-1331-49e2-8c51-37d9a91c8109', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fcd2d1-9229-4bfc-8dd6-3ff6fc9734a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14fcd2d1-9229-4bfc-8dd6-3ff6fc9734a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03aa070-c156-426a-966d-047ba46b511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Volume fb41ea03-1331-49e2-8c51-37d9a91c8109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb41ea03-1331-49e2-8c51-37d9a91c8109', 'volume_size': 1}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:46 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.165s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-799511092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb41ea03-1331-49e2-8c51-37d9a91c8109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10e8da55b11c453a91a2a268522dc366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:05:46Z,use_quota=True,user_id='5cc0e3efa7964794a05571ad41349e9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Creating volume fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:05:46 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc51d9a-db1f-4f9a-8067-e4030f59c258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e791e2-64a0-4573-a9c8-ff6684496f32', 'volume_size': 2}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeecd89-9957-4e38-9566-e102f3bf801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:46 devstack sudo[100965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 1073741824
Sep 04 06:05:46 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Volume volume-58e791e2-64a0-4573-a9c8-ff6684496f32 (58e791e2-64a0-4573-a9c8-ff6684496f32): created successfully
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddeecd89-9957-4e38-9566-e102f3bf801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Flow 'volume_create_manager' (09ae2280-f6b5-43ef-8d6f-6b034ede3b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-664f55af-e491-46c7-bae9-5213ba1be669 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Created volume successfully.
Sep 04 06:05:47 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 1073741824" returned: 0 in 0.536s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:47 devstack sudo[100974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109
Sep 04 06:05:47 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:47 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03aa070-c156-426a-966d-047ba46b511a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb41ea03-1331-49e2-8c51-37d9a91c8109', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f78cf6-7763-4643-b61c-8455415ba62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:05:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Volume volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 (fb41ea03-1331-49e2-8c51-37d9a91c8109): created successfully
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2f78cf6-7763-4643-b61c-8455415ba62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Flow 'volume_create_manager' (6c9bf0bb-2f6a-486c-8e16-124b17fa7faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:05:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9caafabf-839b-476c-993d-ad1ef65a85cd tempest-SnapshotMetadataTestJSON-2030087844 None] Created volume successfully.
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Creating offline snapshot f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 of volume 58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[495fb991-563d-4da7-a9fa-05c15fc78474]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:47 devstack sudo[100980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32
Sep 04 06:05:47 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:48 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 2G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:48 devstack sudo[100988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 2G
Sep 04 06:05:48 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:48 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 2G" returned: 0 in 0.728s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e791e2-64a0-4573-a9c8-ff6684496f32 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:48 devstack sudo[100994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e791e2-64a0-4573-a9c8-ff6684496f32 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80
Sep 04 06:05:48 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:49 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58e791e2-64a0-4573-a9c8-ff6684496f32 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 is being set with open permissions: ugo+rw
Sep 04 06:05:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:49 devstack sudo[101000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80
Sep 04 06:05:49 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:49 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:49 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info
Sep 04 06:05:49 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:50 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info is being set with open permissions: ugo+rw
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:50 devstack sudo[101007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info
Sep 04 06:05:50 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:50 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.info" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.945s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.995s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Creating offline snapshot cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 of volume fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:05:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d6e96363-e487-4e71-8afb-796fa8b007aa tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Create snapshot completed successfully
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24e9d1b-77b6-4ec6-b8d1-80ee31acce70]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:50 devstack sudo[101021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109
Sep 04 06:05:50 devstack sudo[101021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "cinder-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "cinder-quobyte-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Deleting offline snapshot f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 of volume 58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] snapshot_file for this snap is: volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[77885120-48d1-4124-bc7d-b97bf9054093]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:51 devstack sudo[101021]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109" returned: 0 in 0.658s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:51 devstack sudo[101030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80
Sep 04 06:05:51 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:51 devstack sudo[101033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 1G
Sep 04 06:05:51 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:51 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" returned: 0 in 0.480s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58e791e2-64a0-4573-a9c8-ff6684496f32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc14ca9-585c-4e56-9dd0-edbb6711cce7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:51 devstack sudo[101041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32
Sep 04 06:05:51 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:51 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 1G" returned: 0 in 0.560s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:51 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5
Sep 04 06:05:51 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:52 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:52 devstack sudo[101051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80
Sep 04 06:05:52 devstack sudo[101051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:52 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:52 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 is being set with open permissions: ugo+rw
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:52 devstack sudo[101055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5
Sep 04 06:05:52 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:52 devstack sudo[101051]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" returned: 0 in 0.482s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:52 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:52 devstack sudo[101061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80
Sep 04 06:05:52 devstack sudo[101061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:52 devstack sudo[101063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info
Sep 04 06:05:52 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:53 devstack sudo[101061]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:53 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32.f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info" returned: 0 in 0.324s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:53 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info is being set with open permissions: ugo+rw
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:53 devstack sudo[101067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info
Sep 04 06:05:53 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80" released by "_delete_snapshot" :: held 2.017s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" released by "delete_snapshot" :: held 2.061s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Created reservations ['f9db1720-dbff-437f-9aac-868756d6d1b9', '8b44e609-f2f0-4a43-9d31-cb9dba9ee6a3', 'bc57e138-19fb-4634-9bc2-232c13c38017', '557984bf-46a4-4d4c-a2ea-f5b53fe08ef9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=97,cinder:INSERT=32,cinder:UPDATE=116,cinder:DELETE=10 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:05:53 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:INSERT=32,cinder:UPDATE=125,cinder:SELECT=99,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.info" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.885s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d71cf0ae-7a62-4a51-8e9f-439b906c9607 tempest-SnapshotMetadataTestJSON-2030087844 None] Create snapshot completed successfully
Sep 04 06:05:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Delete snapshot completed successfully.
Sep 04 06:05:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ca7787bc-ebe2-4bae-91f1-374a1d3135d5 tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-f00a4dd5-1ceb-40e5-9ae4-5b75a83a1a80-delete_snapshot" released by "delete_snapshot" :: held 2.487s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "cinder-58e791e2-64a0-4573-a9c8-ff6684496f32-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-58e791e2-64a0-4573-a9c8-ff6684496f32-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0fca0a-4c3b-4f20-9f76-fb671b8b4e71]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:54 devstack sudo[101071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32
Sep 04 06:05:54 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "cinder-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "cinder-quobyte-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Deleting offline snapshot cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 of volume fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] snapshot_file for this snap is: volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e38c43-bc71-4002-afe1-754aad6b5314]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:55 devstack sudo[101073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5
Sep 04 06:05:55 devstack sudo[101073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:55 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32" returned: 0 in 0.606s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:55 devstack sudo[101078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32
Sep 04 06:05:55 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:55 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-58e791e2-64a0-4573-a9c8-ff6684496f32" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-quobyte-58e791e2-64a0-4573-a9c8-ff6684496f32" released by "delete_volume" :: held 1.216s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:55 devstack sudo[101073]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" returned: 0 in 0.826s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb41ea03-1331-49e2-8c51-37d9a91c8109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c958be5-ca99-42b0-8312-890d440fcc16]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Created reservations ['9f65ac89-68ef-478e-9019-de843740a167', '56ddb942-366a-440a-abea-18b96411abdd', '6b03ee1b-6e37-4b7f-bc28-8acfb631512c', '6a03d9cf-eb53-4ae0-bc0b-5ed6144e78ff'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:05:56 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109
Sep 04 06:05:56 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:56 devstack sudo[101132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:05:56 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:56 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109" returned: 0 in 0.793s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:56 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5
Sep 04 06:05:56 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:56 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.595s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:05:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Deleted volume successfully.
Sep 04 06:05:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11c0f0cb-cfc8-4c47-b7c0-c68a80e8056a tempest-VolumesSnapshotNegativeTestJSON-1728535150 None] Lock "cinder-58e791e2-64a0-4573-a9c8-ff6684496f32-delete_volume" released by "delete_volume" :: held 2.409s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:57 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" returned: 0 in 0.707s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:57 devstack sudo[101163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5
Sep 04 06:05:57 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:05:57 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root
Sep 04 06:05:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109.cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" returned: 0 in 0.578s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:05:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5" released by "_delete_snapshot" :: held 3.178s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" released by "delete_snapshot" :: held 3.228s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Created reservations ['78feedac-026e-4f8e-ab01-068f37a27874', '96b74425-b2cb-41b3-a24f-2bc6f95940bc', 'e14a61fc-88e4-4652-b3cd-ddbb3ead805b', 'e00b894a-0c5a-49a3-a728-b4acd0d4168b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:05:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Delete snapshot completed successfully.
Sep 04 06:05:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9b56bad1-5850-438e-a598-a24ba77d065a tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-cb90aff4-1ba9-4611-af7d-5d7aeb6598e5-delete_snapshot" released by "delete_snapshot" :: held 3.543s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "cinder-fb41ea03-1331-49e2-8c51-37d9a91c8109-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-fb41ea03-1331-49e2-8c51-37d9a91c8109-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f8cd76-0d90-4728-9185-dab6d032d097]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:05:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:05:59 devstack sudo[101169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109
Sep 04 06:05:59 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:00 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109" returned: 0 in 0.669s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:00 devstack sudo[101174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109
Sep 04 06:06:00 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:01 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fb41ea03-1331-49e2-8c51-37d9a91c8109" returned: 0 in 0.684s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-quobyte-fb41ea03-1331-49e2-8c51-37d9a91c8109" released by "delete_volume" :: held 1.447s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Created reservations ['6d88ab08-428b-4796-ab69-f992939e67bf', 'bec33760-a379-4734-9f12-485e61b42ed8', '262b8674-cd5c-480a-9548-bdce009a1816', '076eb480-28b2-4f6e-9776-766b8ad30d04'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:01 devstack sudo[101178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:06:01 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:01 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:06:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Deleted volume successfully.
Sep 04 06:06:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf97dc8d-fae7-4980-aeb5-91978673416d tempest-SnapshotMetadataTestJSON-2030087844 None] Lock "cinder-fb41ea03-1331-49e2-8c51-37d9a91c8109-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Flow 'volume_create_manager' (6026c4b6-629b-4e0d-9049-dca0b3e4243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e086c-4f30-4c43-9223-f63412881619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e086c-4f30-4c43-9223-f63412881619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1072114566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b40830-501d-4f95-829c-31127e3eb423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ec2fa8bf4148f8bf67127604fb21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:08Z,use_quota=True,user_id='8ada7f6455fb4c34bb8a90da1f22458c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d28864-5282-41e3-98d4-cef23f39631b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d28864-5282-41e3-98d4-cef23f39631b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735b262f-84c2-4902-a1ce-28db1060ff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (735b262f-84c2-4902-a1ce-28db1060ff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b40830-501d-4f95-829c-31127e3eb423', 'volume_name': 'volume-e2b40830-501d-4f95-829c-31127e3eb423', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3374905-ccab-402f-8427-20cfcf45fdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3374905-ccab-402f-8427-20cfcf45fdaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c2d30-d2f9-48d6-944b-c6c25a865bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Volume e2b40830-501d-4f95-829c-31127e3eb423: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b40830-501d-4f95-829c-31127e3eb423', 'volume_size': 1}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1072114566',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b40830-501d-4f95-829c-31127e3eb423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23ec2fa8bf4148f8bf67127604fb21e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:08Z,use_quota=True,user_id='8ada7f6455fb4c34bb8a90da1f22458c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Creating volume e2b40830-501d-4f95-829c-31127e3eb423 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:08 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 1073741824
Sep 04 06:06:08 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:08 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 1073741824" returned: 0 in 0.591s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:09 devstack sudo[101188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423
Sep 04 06:06:09 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:09 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423" returned: 0 in 0.516s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c2d30-d2f9-48d6-944b-c6c25a865bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b40830-501d-4f95-829c-31127e3eb423', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6e2869-520a-4646-958b-544c7f45ea53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Volume volume-e2b40830-501d-4f95-829c-31127e3eb423 (e2b40830-501d-4f95-829c-31127e3eb423): created successfully
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b6e2869-520a-4646-958b-544c7f45ea53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Flow 'volume_create_manager' (6026c4b6-629b-4e0d-9049-dca0b3e4243c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e58d411a-4a15-42d8-a791-0293372e0bb3 tempest-VolumesMetadataTest-225193138 None] Created volume successfully.
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Acquiring lock "cinder-e2b40830-501d-4f95-829c-31127e3eb423-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "cinder-e2b40830-501d-4f95-829c-31127e3eb423-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Acquiring lock "cinder-quobyte-e2b40830-501d-4f95-829c-31127e3eb423" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "cinder-quobyte-e2b40830-501d-4f95-829c-31127e3eb423" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2da92f-ff78-41ec-860b-93aeeeee889c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:11 devstack sudo[101214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423
Sep 04 06:06:11 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:12 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:12 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423
Sep 04 06:06:12 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:12 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e2b40830-501d-4f95-829c-31127e3eb423" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "cinder-quobyte-e2b40830-501d-4f95-829c-31127e3eb423" released by "delete_volume" :: held 0.742s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Created reservations ['849b64ec-1f92-48a4-b51a-969865084312', '7b43fa21-b58d-48ae-8017-2e698177da0a', 'b3c17616-b9b2-4fdc-b05f-5c1a7c2f9b42', '8b1db335-d928-4e38-a7b6-1a1d92a50dfe'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:12 devstack sudo[101224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:06:12 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:12 devstack sudo[101226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:06:12 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:12 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:06:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Deleted volume successfully.
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-33cf13a3-8496-475e-9e4b-7d8f085d1434 tempest-VolumesMetadataTest-225193138 None] Lock "cinder-e2b40830-501d-4f95-829c-31127e3eb423-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:12 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.342s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:06:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:06:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=24,cinder:UPDATE=37,cinder:INSERT=9 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:06:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:DELETE=5,cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=37 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (efcbe7a8-e0a3-459c-85ba-a73d59a3ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728e6312-62fc-4b2d-bd79-38241a86adf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728e6312-62fc-4b2d-bd79-38241a86adf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481944342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18552db7-13c2-4737-8eba-a42a677eb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:24Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edddb3a5-3716-417f-8dfe-56a5f22d5464),volume_type_id=edddb3a5-3716-417f-8dfe-56a5f22d5464)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4326fb3-c868-40d5-9ba3-2a5c859b53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4326fb3-c868-40d5-9ba3-2a5c859b53e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be988dfa-60dd-4176-82d0-b24010cbbaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be988dfa-60dd-4176-82d0-b24010cbbaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18552db7-13c2-4737-8eba-a42a677eb7d8', 'volume_name': 'volume-18552db7-13c2-4737-8eba-a42a677eb7d8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6576a-3f10-43e1-b5bd-1924fc48c054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b6576a-3f10-43e1-b5bd-1924fc48c054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d29ad-9ad4-42b9-bf49-a4b04e343e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume 18552db7-13c2-4737-8eba-a42a677eb7d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18552db7-13c2-4737-8eba-a42a677eb7d8', 'volume_size': 1}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481944342',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18552db7-13c2-4737-8eba-a42a677eb7d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:24Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edddb3a5-3716-417f-8dfe-56a5f22d5464),volume_type_id=edddb3a5-3716-417f-8dfe-56a5f22d5464)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Creating volume 18552db7-13c2-4737-8eba-a42a677eb7d8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:24 devstack sudo[101242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 1073741824
Sep 04 06:06:24 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (1277833a-96bf-443b-ac77-4022866057e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639304be-8b30-4274-9fac-e38c949f590f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639304be-8b30-4274-9fac-e38c949f590f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1294608749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b01c05-702c-41e9-8952-701cbc5e0eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:25Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8bc96f9-f18b-411f-9912-49fb8edfc22f),volume_type_id=e8bc96f9-f18b-411f-9912-49fb8edfc22f)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e3ec7-86ba-4f03-8b79-b2e8cd7bbf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e3ec7-86ba-4f03-8b79-b2e8cd7bbf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838ebdc9-96fd-417a-8b1b-6b53f4144019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838ebdc9-96fd-417a-8b1b-6b53f4144019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09b01c05-702c-41e9-8952-701cbc5e0eda', 'volume_name': 'volume-09b01c05-702c-41e9-8952-701cbc5e0eda', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca82f29-a66e-4bf7-b837-e62a3ca13055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:25 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca82f29-a66e-4bf7-b837-e62a3ca13055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cafbbd-e913-4e96-b301-7404549d762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume 09b01c05-702c-41e9-8952-701cbc5e0eda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09b01c05-702c-41e9-8952-701cbc5e0eda', 'volume_size': 1}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 1073741824" returned: 0 in 0.697s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:25 devstack sudo[101248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8
Sep 04 06:06:25 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:25 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1294608749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09b01c05-702c-41e9-8952-701cbc5e0eda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:25Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8bc96f9-f18b-411f-9912-49fb8edfc22f),volume_type_id=e8bc96f9-f18b-411f-9912-49fb8edfc22f)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Creating volume 09b01c05-702c-41e9-8952-701cbc5e0eda {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:26 devstack sudo[101251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda 1073741824
Sep 04 06:06:26 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (706d29ad-9ad4-42b9-bf49-a4b04e343e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18552db7-13c2-4737-8eba-a42a677eb7d8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5385d567-da85-44ae-866a-fbb0d698817a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume volume-18552db7-13c2-4737-8eba-a42a677eb7d8 (18552db7-13c2-4737-8eba-a42a677eb7d8): created successfully
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5385d567-da85-44ae-866a-fbb0d698817a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (efcbe7a8-e0a3-459c-85ba-a73d59a3ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4fc5f96b-e100-46e3-a4ee-881d554b713f tempest-TestInstancesWithCinderVolumes-1464211743 None] Created volume successfully.
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (d89f0549-00ef-4136-bc5d-f06387d169aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ae90d-5b02-4232-b327-5ff5086935a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (825ae90d-5b02-4232-b327-5ff5086935a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2057913792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcde8cc-b5b1-469e-8b5c-91137af01291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:26Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd862fbd-dc4f-4971-b7ad-5251f7c1803b),volume_type_id=bd862fbd-dc4f-4971-b7ad-5251f7c1803b)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715f0cc5-d580-4a7f-b299-9b14e4b6ce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715f0cc5-d580-4a7f-b299-9b14e4b6ce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b49441-2170-4043-beb5-5f30b25ed621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:06:26 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda 1073741824" returned: 0 in 0.844s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:26 devstack sudo[101257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda
Sep 04 06:06:26 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:26 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Flow 'volume_create_manager' (981b20fc-1237-466c-9bc2-57ba21039e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b20fe24-27c1-429d-9d17-4c9522818d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b20fe24-27c1-429d-9d17-4c9522818d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1323431020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17318ac643f74ad6b74a0463e03b8704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:27Z,use_quota=True,user_id='5d2926484236419aaa18dcb634fc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983167ca-e3ab-4a10-a9bb-b84ee4e06635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983167ca-e3ab-4a10-a9bb-b84ee4e06635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4c4452-55b7-4c58-b23e-9b85e55498c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c4c4452-55b7-4c58-b23e-9b85e55498c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f', 'volume_name': 'volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801463c2-9ea4-4c87-98ce-fe0d039d4ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801463c2-9ea4-4c87-98ce-fe0d039d4ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d6628e-e517-467e-b713-711c1a30dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Volume 592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f', 'volume_size': 1}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65b49441-2170-4043-beb5-5f30b25ed621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdcde8cc-b5b1-469e-8b5c-91137af01291', 'volume_name': 'volume-fdcde8cc-b5b1-469e-8b5c-91137af01291', 'volume_size': 1, 'image_id': '2625646c-c7a9-4c02-9224-1d401e335935', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1726134189', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd691d95e371e4e76a29abb91b1cedca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2625646c-c7a9-4c02-9224-1d401e335935', 'created_at': datetime.datetime(2026, 9, 4, 4, 6, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2625646c-c7a9-4c02-9224-1d401e335935/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e61d850>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0d953-b5ac-4a8e-9eea-450e8a3a7052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0d953-b5ac-4a8e-9eea-450e8a3a7052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb45611e-0812-47d6-87b6-8045b1cd662b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume fdcde8cc-b5b1-469e-8b5c-91137af01291: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdcde8cc-b5b1-469e-8b5c-91137af01291', 'volume_size': 1, 'image_id': '2625646c-c7a9-4c02-9224-1d401e335935', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1726134189', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd691d95e371e4e76a29abb91b1cedca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2625646c-c7a9-4c02-9224-1d401e335935', 'created_at': datetime.datetime(2026, 9, 4, 4, 6, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2625646c-c7a9-4c02-9224-1d401e335935/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e61d850>}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Trying to clone fdcde8cc-b5b1-469e-8b5c-91137af01291 from image 2625646c-c7a9-4c02-9224-1d401e335935 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:06:27 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] <== create_volume: return (1246ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.113s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1323431020',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17318ac643f74ad6b74a0463e03b8704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:27Z,use_quota=True,user_id='5d2926484236419aaa18dcb634fc85fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Creating volume 592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:27 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38cafbbd-e913-4e96-b301-7404549d762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09b01c05-702c-41e9-8952-701cbc5e0eda', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6750d662-ff77-421c-b555-4152fae71b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:27 devstack sudo[101260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f 1073741824
Sep 04 06:06:27 devstack sudo[101260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:27 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume volume-09b01c05-702c-41e9-8952-701cbc5e0eda (09b01c05-702c-41e9-8952-701cbc5e0eda): created successfully
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6750d662-ff77-421c-b555-4152fae71b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (1277833a-96bf-443b-ac77-4022866057e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4e25a021-c462-4378-bff3-4c0a7f608f0a tempest-TestInstancesWithCinderVolumes-1464211743 None] Created volume successfully.
Sep 04 06:06:27 devstack sudo[101260]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f 1073741824" returned: 0 in 0.694s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:28 devstack sudo[101266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f
Sep 04 06:06:28 devstack sudo[101266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:28 devstack sudo[101266]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d6628e-e517-467e-b713-711c1a30dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be428443-9503-4eb6-9222-e42c142e95b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Volume volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f (592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f): created successfully
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be428443-9503-4eb6-9222-e42c142e95b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Flow 'volume_create_manager' (981b20fc-1237-466c-9bc2-57ba21039e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-87b4ef44-0f53-4fb5-83b8-8331a3422e36 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Created volume successfully.
Sep 04 06:06:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-0aed9df7-9726-4aab-b05a-0564b55fa773 req-135e9917-e9ab-4d7d-b9d8-a323868dee6d tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-0aed9df7-9726-4aab-b05a-0564b55fa773 req-135e9917-e9ab-4d7d-b9d8-a323868dee6d tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-0aed9df7-9726-4aab-b05a-0564b55fa773 req-135e9917-e9ab-4d7d-b9d8-a323868dee6d tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.071s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-0aed9df7-9726-4aab-b05a-0564b55fa773 req-135e9917-e9ab-4d7d-b9d8-a323868dee6d tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2912f41f-0e1f-4f4e-98f4-06e0ab9daf48', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:06:30 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-0aed9df7-9726-4aab-b05a-0564b55fa773 req-135e9917-e9ab-4d7d-b9d8-a323868dee6d tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] attachment_update completed successfully.
Sep 04 06:06:32 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD, size 20.69 MB, duration 5.57 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:06:32 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Image download 20.69 MB at 3.71 MB/s
Sep 04 06:06:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5223a4-f552-479a-a443-23e77c81d8e6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:32 devstack sudo[101664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD
Sep 04 06:06:32 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:33 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Temporary image 2625646c-c7a9-4c02-9224-1d401e335935 is fetched for user 34fe4dee14b244af8aadc50c2af8cb30. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17d96d1-245c-4045-ad20-781e62b45bf0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:33 devstack sudo[101685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD
Sep 04 06:06:33 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:33 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2057913792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcde8cc-b5b1-469e-8b5c-91137af01291,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d691d95e371e4e76a29abb91b1cedca0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:26Z,use_quota=True,user_id='34fe4dee14b244af8aadc50c2af8cb30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd862fbd-dc4f-4971-b7ad-5251f7c1803b),volume_type_id=bd862fbd-dc4f-4971-b7ad-5251f7c1803b)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Creating volume fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:33 devstack sudo[101711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1073741824
Sep 04 06:06:33 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:34 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1073741824" returned: 0 in 0.697s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:34 devstack sudo[101720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291
Sep 04 06:06:34 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-0d320694-62e1-44f6-b287-c1721ba6f90e req-cf376723-136e-4250-87e8-34baf1a62dfd tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Terminate volume connection completed successfully.
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-0d320694-62e1-44f6-b287-c1721ba6f90e req-cf376723-136e-4250-87e8-34baf1a62dfd tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Deleting attachment 2912f41f-0e1f-4f4e-98f4-06e0ab9daf48. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:06:34 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:34 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Attempting download of 2625646c-c7a9-4c02-9224-1d401e335935 ((None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}])) to volume fdcde8cc-b5b1-469e-8b5c-91137af01291. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f619e7a-7c11-4b32-a801-8caa3a9b3d7f]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:35 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl
Sep 04 06:06:35 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:35 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl" returned: 0 in 0.476s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "cinder-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:35 devstack sudo[101753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl
Sep 04 06:06:35 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "cinder-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "cinder-quobyte-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "cinder-quobyte-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8f2e4-29db-4fef-958a-fa655badf7f1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:36 devstack sudo[101755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f
Sep 04 06:06:36 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:36 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl" returned: 1 in 0.570s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2625646c-c7a9-4c02-9224-1d401e335935_hmifsyxl' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c08fc6-ab3e-4a07-a369-ba0c72fe557e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:36 devstack sudo[101759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD
Sep 04 06:06:36 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:36 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" returned: 0 in 0.674s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:36 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] 2625646c-c7a9-4c02-9224-1d401e335935 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:36 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f
Sep 04 06:06:36 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:36 devstack sudo[101770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291
Sep 04 06:06:36 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:36 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "cinder-quobyte-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f" released by "delete_volume" :: held 1.153s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Created reservations ['f9b3fb46-6bdc-47fe-b399-157656dd2459', 'b0e1942c-28ae-4983-a98e-387bf7dbd290', 'da3e1f25-160c-4ff8-bede-185f986516ff', 'b1689cd3-c0ad-4c88-a625-58fcf2576e70'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:37 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:06:37 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Flow 'volume_create_manager' (ac45ad08-6c5b-4f40-adb2-705577d457ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194a3f49-0c00-4029-84c5-114074a59605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (194a3f49-0c00-4029-84c5-114074a59605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1229086746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c21aeff-4a34-4445-9ef8-c3f74c082b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dca78f2a3e34ccfae4f0eb1560a6ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:37Z,use_quota=True,user_id='68b4d6957aee47cd91797d2b67bd10c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7631956-d051-46c8-91be-0d2378068fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7631956-d051-46c8-91be-0d2378068fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b9b827-4c76-44da-9a01-9ab426217313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2b9b827-4c76-44da-9a01-9ab426217313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c21aeff-4a34-4445-9ef8-c3f74c082b37', 'volume_name': 'volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6da5e90-f189-403d-8ace-2e0604edf04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6da5e90-f189-403d-8ace-2e0604edf04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b66af5-365e-4351-a374-be87ac709109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Volume 7c21aeff-4a34-4445-9ef8-c3f74c082b37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37', 'volume_size': 1}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1229086746',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c21aeff-4a34-4445-9ef8-c3f74c082b37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dca78f2a3e34ccfae4f0eb1560a6ae6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:37Z,use_quota=True,user_id='68b4d6957aee47cd91797d2b67bd10c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Creating volume 7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:37 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:37 devstack sudo[101780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 1073741824
Sep 04 06:06:37 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:37 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:06:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Deleted volume successfully.
Sep 04 06:06:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3461f209-6551-4c02-bb6a-95259734de78 tempest-TestServerVolumeAttachScenarioOldVersion-867788490 None] Lock "cinder-592cf59a-ca1a-4a3f-a8ec-b9bb1488bd3f-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:38 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 1073741824" returned: 0 in 0.863s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:38 devstack sudo[101786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:06:38 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:38 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6b66af5-365e-4351-a374-be87ac709109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0803a-32e0-4b72-81be-591e12f86cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Volume volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 (7c21aeff-4a34-4445-9ef8-c3f74c082b37): created successfully
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfb0803a-32e0-4b72-81be-591e12f86cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Flow 'volume_create_manager' (ac45ad08-6c5b-4f40-adb2-705577d457ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-dcc6ffac-f232-4b72-8bdf-d1dbd4f5ba61 tempest-TestImageHashVerification-978499936 None] Created volume successfully.
Sep 04 06:06:39 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291" returned: 0 in 2.898s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2625646c-c7a9-4c02-9224-1d401e335935_3fq6oremdevstack@QuobyteHD, size 112.00 MB, duration 2.90 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:06:39 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Converted 112.00 MB image at 38.63 MB/s
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:39 devstack sudo[101812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1G
Sep 04 06:06:39 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Flow 'volume_create_manager' (d96d9e80-1f54-4e94-b65c-f03224e4f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124fa9fd-77b5-4270-9289-46f1b47c0055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (124fa9fd-77b5-4270-9289-46f1b47c0055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660850457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4bc349-78e3-4462-a893-2d7eb33d61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a62abce64a4ffab2acabce0c5cb166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:40Z,use_quota=True,user_id='246c9b9d796d451fba2c0add05669ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6790ac7e-550b-49cc-b196-c0224682d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6790ac7e-550b-49cc-b196-c0224682d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9761f169-7368-4a67-b845-720a380d54dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9761f169-7368-4a67-b845-720a380d54dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa4bc349-78e3-4462-a893-2d7eb33d61c8', 'volume_name': 'volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e8c6b-da32-4ffb-96cc-ce18ad71c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (884e8c6b-da32-4ffb-96cc-ce18ad71c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2a4c1d-38cb-4fe8-98c1-2b81b9b6d0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Volume aa4bc349-78e3-4462-a893-2d7eb33d61c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8', 'volume_size': 1}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1660850457',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa4bc349-78e3-4462-a893-2d7eb33d61c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14a62abce64a4ffab2acabce0c5cb166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:06:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:06:40Z,use_quota=True,user_id='246c9b9d796d451fba2c0add05669ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Creating volume aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:06:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:06:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:39 devstack sudo[101814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 1073741824
Sep 04 06:06:39 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:40 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 1G" returned: 0 in 0.568s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Downloaded image 2625646c-c7a9-4c02-9224-1d401e335935 ((None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}])) to volume fdcde8cc-b5b1-469e-8b5c-91137af01291 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Temporary image 2625646c-c7a9-4c02-9224-1d401e335935 for user 34fe4dee14b244af8aadc50c2af8cb30 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Marking volume fdcde8cc-b5b1-469e-8b5c-91137af01291 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Copying metadata from image 2625646c-c7a9-4c02-9224-1d401e335935 to fdcde8cc-b5b1-469e-8b5c-91137af01291. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Creating volume glance metadata for volume fdcde8cc-b5b1-469e-8b5c-91137af01291 backed by image 2625646c-c7a9-4c02-9224-1d401e335935 with: {'image_id': '2625646c-c7a9-4c02-9224-1d401e335935', 'image_name': 'tempest-scenario-img--1726134189', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb45611e-0812-47d6-87b6-8045b1cd662b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcde8cc-b5b1-469e-8b5c-91137af01291', 'volume_size': 1, 'image_id': '2625646c-c7a9-4c02-9224-1d401e335935', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2625646c-c7a9-4c02-9224-1d401e335935', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1726134189', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd691d95e371e4e76a29abb91b1cedca0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2625646c-c7a9-4c02-9224-1d401e335935', 'created_at': datetime.datetime(2026, 9, 4, 4, 6, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2625646c-c7a9-4c02-9224-1d401e335935/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e61d850>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66616097-d376-4b20-af07-6e4ce75ae60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Volume volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 (fdcde8cc-b5b1-469e-8b5c-91137af01291): created successfully
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66616097-d376-4b20-af07-6e4ce75ae60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Flow 'volume_create_manager' (d89f0549-00ef-4136-bc5d-f06387d169aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2edf37b8-9266-4b40-81e7-85a5dac2f623 tempest-TestInstancesWithCinderVolumes-1464211743 None] Created volume successfully.
Sep 04 06:06:40 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 1073741824" returned: 0 in 0.725s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:40 devstack sudo[101825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:06:40 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:40 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.243s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2a4c1d-38cb-4fe8-98c1-2b81b9b6d0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c5cf01-ebf5-498e-a6fb-38de02dd3c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e851b423-48d8-4487-a5f6-11750539cc7c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Volume volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 (aa4bc349-78e3-4462-a893-2d7eb33d61c8): created successfully
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c5cf01-ebf5-498e-a6fb-38de02dd3c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:06:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Flow 'volume_create_manager' (d96d9e80-1f54-4e94-b65c-f03224e4f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:06:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e7e78b28-329b-4c1d-9db0-567c577540b9 tempest-VolumesActionsTest-1817783721 None] Created volume successfully.
Sep 04 06:06:41 devstack sudo[101829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:06:41 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:41 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c4b22-47ab-4b66-9788-57a2c7d627b0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:41 devstack sudo[101835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:06:41 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:41 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.589s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 /opt/stack/data/cinder/conversion/7c21aeff-4a34-4445-9ef8-c3f74c082b37.temp_image.3708d18c-f340-4606-88a9-9ea0e543707bke2qw4pu.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:41 devstack sudo[101846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 /opt/stack/data/cinder/conversion/7c21aeff-4a34-4445-9ef8-c3f74c082b37.temp_image.3708d18c-f340-4606-88a9-9ea0e543707bke2qw4pu.img
Sep 04 06:06:41 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-af995fa7-0761-43d0-870b-e7bb12269e87 req-861720aa-c77b-4ea3-a5c6-4de709dfae9e tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:06:48 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 /opt/stack/data/cinder/conversion/7c21aeff-4a34-4445-9ef8-c3f74c082b37.temp_image.3708d18c-f340-4606-88a9-9ea0e543707bke2qw4pu.img" returned: 0 in 6.906s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b99cd12-415a-41d6-8a0c-b55f73cf7d2d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:06:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:06:49 devstack sudo[101885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:06:49 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:06:49 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root
Sep 04 06:06:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.683s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:06:49 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/conversion/7c21aeff-4a34-4445-9ef8-c3f74c082b37.temp_image.3708d18c-f340-4606-88a9-9ea0e543707bke2qw4pu.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:06:49 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Converted 1024.00 MB image at 148.26 MB/s
Sep 04 06:06:49 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] 3708d18c-f340-4606-88a9-9ea0e543707b was raw, no need to convert to raw {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 04 06:06:56 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=34,cinder:UPDATE=29,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c918b3f4-c782-4b52-b2e7-314daf4b809f tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c918b3f4-c782-4b52-b2e7-314daf4b809f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" acquired by "attach_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c918b3f4-c782-4b52-b2e7-314daf4b809f tempest-VolumesActionsTest-1817783721 None] Attaching volume aa4bc349-78e3-4462-a893-2d7eb33d61c8 to instance 70dcc9c8-65f9-4f9c-9b79-f50f60f2d836 at mountpoint /dev/vdb on host None.
Sep 04 06:06:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c918b3f4-c782-4b52-b2e7-314daf4b809f tempest-VolumesActionsTest-1817783721 None] Attach volume completed successfully.
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c918b3f4-c782-4b52-b2e7-314daf4b809f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" released by "attach_volume" :: held 0.144s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-87c0293c-0631-46a2-bf33-481fa9c52b48 tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-87c0293c-0631-46a2-bf33-481fa9c52b48 tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:06:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-87c0293c-0631-46a2-bf33-481fa9c52b48 tempest-VolumesActionsTest-1817783721 None] Detaching volume aa4bc349-78e3-4462-a893-2d7eb33d61c8 from instance 70dcc9c8-65f9-4f9c-9b79-f50f60f2d836.
Sep 04 06:06:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-87c0293c-0631-46a2-bf33-481fa9c52b48 tempest-VolumesActionsTest-1817783721 None] Detach volume completed successfully.
Sep 04 06:06:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-87c0293c-0631-46a2-bf33-481fa9c52b48 tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" released by "detach_volume" :: held 0.103s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:07:09 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:07:09 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=33,cinder:SELECT=39,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:07:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:12 devstack sudo[102083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:07:12 devstack sudo[102083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:13 devstack sudo[102083]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.524s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:07:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:07:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:07:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b08a003-ba84-4636-8333-06c3a93755dd tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" by "attach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b08a003-ba84-4636-8333-06c3a93755dd tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" acquired by "attach_volume" :: waited 0.046s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:07:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b08a003-ba84-4636-8333-06c3a93755dd tempest-VolumesActionsTest-1817783721 None] Attaching volume aa4bc349-78e3-4462-a893-2d7eb33d61c8 to instance b05cc2e7-b1b8-46df-bc1b-96eae2247bff at mountpoint /dev/vdb on host None.
Sep 04 06:07:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b08a003-ba84-4636-8333-06c3a93755dd tempest-VolumesActionsTest-1817783721 None] Attach volume completed successfully.
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b08a003-ba84-4636-8333-06c3a93755dd tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8" released by "attach_volume" :: held 0.181s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3c022ac5-b66b-4fdd-88f7-4190c3e398d8 tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" by "detach_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3c022ac5-b66b-4fdd-88f7-4190c3e398d8 tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:07:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3c022ac5-b66b-4fdd-88f7-4190c3e398d8 tempest-VolumesActionsTest-1817783721 None] Detaching volume aa4bc349-78e3-4462-a893-2d7eb33d61c8 from instance b05cc2e7-b1b8-46df-bc1b-96eae2247bff.
Sep 04 06:07:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3c022ac5-b66b-4fdd-88f7-4190c3e398d8 tempest-VolumesActionsTest-1817783721 None] Detach volume completed successfully.
Sep 04 06:07:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3c022ac5-b66b-4fdd-88f7-4190c3e398d8 tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-detach_volume" released by "detach_volume" :: held 0.219s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:07:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.355s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:07:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Uploaded volume to glance image-id: 3708d18c-f340-4606-88a9-9ea0e543707b. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 06:07:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-af995fa7-0761-43d0-870b-e7bb12269e87 req-861720aa-c77b-4ea3-a5c6-4de709dfae9e tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 33.431s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:07:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-af995fa7-0761-43d0-870b-e7bb12269e87 req-861720aa-c77b-4ea3-a5c6-4de709dfae9e tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:07:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-69ba2cdd-f404-4dfa-b97c-ce435910cbf6 tempest-TestImageHashVerification-978499936 None] Copy volume to image completed successfully.
Sep 04 06:07:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-af995fa7-0761-43d0-870b-e7bb12269e87 req-861720aa-c77b-4ea3-a5c6-4de709dfae9e tempest-TestInstancesWithCinderVolumes-1464211743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-fdcde8cc-b5b1-469e-8b5c-91137af01291', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8c86b33-8eae-4929-b8f9-beac1588c11c', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:07:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-af995fa7-0761-43d0-870b-e7bb12269e87 req-861720aa-c77b-4ea3-a5c6-4de709dfae9e tempest-TestInstancesWithCinderVolumes-1464211743 None] attachment_update completed successfully.
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Acquiring lock "cinder-7c21aeff-4a34-4445-9ef8-c3f74c082b37-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "cinder-7c21aeff-4a34-4445-9ef8-c3f74c082b37-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Acquiring lock "cinder-quobyte-7c21aeff-4a34-4445-9ef8-c3f74c082b37" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "cinder-quobyte-7c21aeff-4a34-4445-9ef8-c3f74c082b37" acquired by "delete_volume" :: waited 0.054s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d71eef-09c8-42f9-b4f7-c10ae7959fac]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:07:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:22 devstack sudo[102570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:07:22 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f98f02-8634-4d8b-9e6f-5864e64fe979]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:23 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.672s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:23 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37
Sep 04 06:07:23 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:23 devstack sudo[102580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:07:23 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:24 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7c21aeff-4a34-4445-9ef8-c3f74c082b37" returned: 0 in 0.759s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "cinder-quobyte-7c21aeff-4a34-4445-9ef8-c3f74c082b37" released by "delete_volume" :: held 1.570s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:07:24 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 1.067s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc34455b-4ef5-4b3c-b9c8-8f8b924a64f0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Created reservations ['6c938cc4-1d83-46e8-8fa7-ce69a890aaf0', 'e5770411-4573-4252-bdcf-7d04722b9b86', '6d4dc51a-ad85-4a74-b1c4-3e0cace8513e', '2e9d1417-30e7-4b6f-bdf7-4df06a1fe46c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:07:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:24 devstack sudo[102590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:07:24 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:24 devstack sudo[102592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:07:24 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:25 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.533s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:07:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Deleted volume successfully.
Sep 04 06:07:25 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9e2fe5f5-3086-4abe-8d88-880368dd74b0 tempest-TestImageHashVerification-978499936 None] Lock "cinder-7c21aeff-4a34-4445-9ef8-c3f74c082b37-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:07:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.907s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c77tvyz9gr.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:25 devstack sudo[102599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c77tvyz9gr.img
Sep 04 06:07:25 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:33 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c77tvyz9gr.img" returned: 0 in 8.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:33 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[522fd3d4-1f13-40b9-96ec-f96dab3f022e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:07:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:07:33 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:07:33 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:07:34 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Sep 04 06:07:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.975s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:07:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c77tvyz9gr.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:07:34 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Converted 1024.00 MB image at 123.65 MB/s
Sep 04 06:07:34 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] 26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c7 was raw, no need to convert to raw {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Sep 04 06:07:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=13,cinder:INSERT=4,cinder:SELECT=16 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:07:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=23,cinder:UPDATE=14,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Flow 'volume_create_manager' (772096e5-c15e-496e-bdb0-75bece22f61c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bd4901-e25f-4ae1-b70d-a67caf217744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93bd4901-e25f-4ae1-b70d-a67caf217744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-415388390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c2b662-b04e-495e-947b-179ab131a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4278189965e4a0eb464f4c6c7d83864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:52Z,use_quota=True,user_id='6262899d094c498a9e2827f5dd1f1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d74aa24-54b1-4033-9667-4cc4f871394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d74aa24-54b1-4033-9667-4cc4f871394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6641da-6332-47d1-816b-48d524ae1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da6641da-6332-47d1-816b-48d524ae1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c2b662-b04e-495e-947b-179ab131a5fd', 'volume_name': 'volume-16c2b662-b04e-495e-947b-179ab131a5fd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be48bb55-7c33-4204-b669-cbfde7557ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be48bb55-7c33-4204-b669-cbfde7557ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c6f9c-23a1-4f47-9c0f-7967f93417c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume 16c2b662-b04e-495e-947b-179ab131a5fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c2b662-b04e-495e-947b-179ab131a5fd', 'volume_size': 1}
Sep 04 06:07:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Flow 'volume_create_manager' (ec8d09ae-3c0a-47ce-a938-c9e35a28a0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bb96ac-f71b-45be-8765-01e5e54433b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50bb96ac-f71b-45be-8765-01e5e54433b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1370837792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec868e-62fa-4ce8-a3b7-cbfce23e387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4278189965e4a0eb464f4c6c7d83864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:53Z,use_quota=True,user_id='6262899d094c498a9e2827f5dd1f1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f487b38-3d52-4355-b03a-e7bc93464e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f487b38-3d52-4355-b03a-e7bc93464e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab615440-cf0d-42ac-bf8f-a82925954b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab615440-cf0d-42ac-bf8f-a82925954b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ec868e-62fa-4ce8-a3b7-cbfce23e387f', 'volume_name': 'volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd65ccc-e4ba-470b-94ee-a5ad904e1aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd65ccc-e4ba-470b-94ee-a5ad904e1aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3600dcc-6f8c-41de-90d6-ccbbaf8b815a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume b1ec868e-62fa-4ce8-a3b7-cbfce23e387f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f', 'volume_size': 1}
Sep 04 06:07:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (f9d0c03c-ec3c-40f5-9316-b4e6c2ba1d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3137f31c-e05f-4ce5-b3a6-d06975f85d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3137f31c-e05f-4ce5-b3a6-d06975f85d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879979417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12479b42-0a80-4b1e-a8a7-0003cdc3e781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:56Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6852138b-aa5d-48bc-8a0e-1567d3dcec0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6852138b-aa5d-48bc-8a0e-1567d3dcec0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb64d594-5cc1-4fc6-bc58-fb81a5148b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb64d594-5cc1-4fc6-bc58-fb81a5148b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12479b42-0a80-4b1e-a8a7-0003cdc3e781', 'volume_name': 'volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094375a-e8bf-4be4-9f6b-837083679995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3094375a-e8bf-4be4-9f6b-837083679995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443da3f-718d-4287-a045-ef4c786ed4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:07:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume 12479b42-0a80-4b1e-a8a7-0003cdc3e781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781', 'volume_size': 1}
Sep 04 06:07:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:07:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-257e98c2-30d3-41a7-bc81-0806a2416f83 req-b23e9f0c-15ca-4510-8d17-358e60ae6ecc tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 41.507s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Uploaded volume to glance image-id: 26cbe1c8-7de2-4fc1-8c22-7ffc08dbe7c7. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.452s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-415388390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c2b662-b04e-495e-947b-179ab131a5fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4278189965e4a0eb464f4c6c7d83864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:52Z,use_quota=True,user_id='6262899d094c498a9e2827f5dd1f1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Creating volume 16c2b662-b04e-495e-947b-179ab131a5fd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:04 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:04 devstack sudo[102812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd 1073741824
Sep 04 06:08:04 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-486fdb00-8827-49e3-8803-2455b5437fbf tempest-VolumesActionsTest-1817783721 None] Copy volume to image completed successfully.
Sep 04 06:08:05 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd 1073741824" returned: 0 in 0.753s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:05 devstack sudo[102828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd
Sep 04 06:08:05 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:06 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.966s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1370837792',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec868e-62fa-4ce8-a3b7-cbfce23e387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4278189965e4a0eb464f4c6c7d83864',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:53Z,use_quota=True,user_id='6262899d094c498a9e2827f5dd1f1870',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Creating volume b1ec868e-62fa-4ce8-a3b7-cbfce23e387f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c6f9c-23a1-4f47-9c0f-7967f93417c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c2b662-b04e-495e-947b-179ab131a5fd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4fed4c-3181-4126-9af3-647e4c601d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:06 devstack sudo[102831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f 1073741824
Sep 04 06:08:06 devstack sudo[102831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume volume-16c2b662-b04e-495e-947b-179ab131a5fd (16c2b662-b04e-495e-947b-179ab131a5fd): created successfully
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f4fed4c-3181-4126-9af3-647e4c601d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Flow 'volume_create_manager' (772096e5-c15e-496e-bdb0-75bece22f61c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cf68c5c5-c152-46ad-a852-c303919f29d8 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Created volume successfully.
Sep 04 06:08:06 devstack sudo[102831]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f 1073741824" returned: 0 in 0.695s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:06 devstack sudo[102837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f
Sep 04 06:08:06 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:07 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1879979417',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12479b42-0a80-4b1e-a8a7-0003cdc3e781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:07:56Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume 12479b42-0a80-4b1e-a8a7-0003cdc3e781 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:07 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3600dcc-6f8c-41de-90d6-ccbbaf8b815a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cdea32-53b1-4c1e-b5f9-c82719d8a8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:07 devstack sudo[102840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 1073741824
Sep 04 06:08:07 devstack sudo[102840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Volume volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f (b1ec868e-62fa-4ce8-a3b7-cbfce23e387f): created successfully
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46cdea32-53b1-4c1e-b5f9-c82719d8a8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Flow 'volume_create_manager' (ec8d09ae-3c0a-47ce-a938-c9e35a28a0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d6b9082a-319b-4117-b966-5beeaf441548 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Created volume successfully.
Sep 04 06:08:07 devstack sudo[102840]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 1073741824" returned: 0 in 0.626s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:08 devstack sudo[102847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781
Sep 04 06:08:08 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:08 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-257e98c2-30d3-41a7-bc81-0806a2416f83 req-b23e9f0c-15ca-4510-8d17-358e60ae6ecc tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-257e98c2-30d3-41a7-bc81-0806a2416f83 req-b23e9f0c-15ca-4510-8d17-358e60ae6ecc tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.149s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0443da3f-718d-4287-a045-ef4c786ed4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac779848-53cd-4397-b287-b7c8801fbaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdead6f8-9cc6-4e53-9f6a-aee027b1c790]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 (12479b42-0a80-4b1e-a8a7-0003cdc3e781): created successfully
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac779848-53cd-4397-b287-b7c8801fbaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (f9d0c03c-ec3c-40f5-9316-b4e6c2ba1d14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7c1339f2-145c-4724-b58b-a50d6cb6b42a tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-257e98c2-30d3-41a7-bc81-0806a2416f83 req-b23e9f0c-15ca-4510-8d17-358e60ae6ecc tempest-TestInstancesWithCinderVolumes-1464211743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-18552db7-13c2-4737-8eba-a42a677eb7d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3889b35b-fe4c-47e6-b29b-2d4f84ad2d47', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:08:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-257e98c2-30d3-41a7-bc81-0806a2416f83 req-b23e9f0c-15ca-4510-8d17-358e60ae6ecc tempest-TestInstancesWithCinderVolumes-1464211743 None] attachment_update completed successfully.
Sep 04 06:08:08 devstack sudo[102853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:08:08 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:09 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.696s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c86969-0da2-44f6-8c3d-487a19c53acc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:09 devstack sudo[102861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:08:09 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (98e7a9c4-7100-4938-9ddb-fedb42c3c8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca77e21-f000-4c61-a948-ff22ec0d3835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca77e21-f000-4c61-a948-ff22ec0d3835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702870476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4342ebb3-790d-4fa5-9202-a0923c4974c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:10Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c44e11-7db6-4079-acb3-e51a0a1d0f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c44e11-7db6-4079-acb3-e51a0a1d0f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d69bde-ac56-4f79-bcca-6057fc574c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d69bde-ac56-4f79-bcca-6057fc574c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4342ebb3-790d-4fa5-9202-a0923c4974c7', 'volume_name': 'volume-4342ebb3-790d-4fa5-9202-a0923c4974c7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35f29e3-cf34-45e7-ba57-18dc1358eab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c35f29e3-cf34-45e7-ba57-18dc1358eab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df276a8c-699a-4906-af02-4d87cede2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume 4342ebb3-790d-4fa5-9202-a0923c4974c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4342ebb3-790d-4fa5-9202-a0923c4974c7', 'volume_size': 1}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:10 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.983s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:10 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img
Sep 04 06:08:10 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (19c8c301-6c24-4374-846c-7c6a005b93df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b40bee7-434b-4f55-a498-8e2fc676ee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b40bee7-434b-4f55-a498-8e2fc676ee3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576732284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e64912b-d9d0-404b-af68-381cdf90927f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:10Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d11e0ef-aa66-4671-92d3-dbf43eaecb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d11e0ef-aa66-4671-92d3-dbf43eaecb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859d779-d2c1-4dc6-9a9b-14ceaf0fb8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9859d779-d2c1-4dc6-9a9b-14ceaf0fb8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e64912b-d9d0-404b-af68-381cdf90927f', 'volume_name': 'volume-1e64912b-d9d0-404b-af68-381cdf90927f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed8b08e-afad-4a84-b023-9b902680547d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed8b08e-afad-4a84-b023-9b902680547d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b3c9d2-105c-4144-bd3d-f148f4e87ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume 1e64912b-d9d0-404b-af68-381cdf90927f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e64912b-d9d0-404b-af68-381cdf90927f', 'volume_size': 1}
Sep 04 06:08:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (876f876c-1023-4ddb-ade0-30187568cfca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec54e8e-80ff-495a-b724-cfec0ae58502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec54e8e-80ff-495a-b724-cfec0ae58502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361474414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2e187c-53b3-4d73-a691-2fb01d3a399e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:11Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf2726b-18e7-4e59-aa27-f9c3b63f866c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaf2726b-18e7-4e59-aa27-f9c3b63f866c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec5adee-f611-4a7f-95e2-4212d4c99dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec5adee-f611-4a7f-95e2-4212d4c99dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2e187c-53b3-4d73-a691-2fb01d3a399e', 'volume_name': 'volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77d5687-5d8d-45c8-944f-34a0eb8578dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77d5687-5d8d-45c8-944f-34a0eb8578dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf21ef4-70d4-4c6b-a993-5c11fde948a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:11 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume bf2e187c-53b3-4d73-a691-2fb01d3a399e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e', 'volume_size': 1}
Sep 04 06:08:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:12 devstack sudo[102898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:12 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:12 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (abe1b564-6cd7-4034-82c7-4bbd2cce1ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43518e0-c52c-4485-94d9-9f0f11a3465d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:13 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43518e0-c52c-4485-94d9-9f0f11a3465d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81058653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73b608-111f-4323-80d1-1c886a70af06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:13Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4decdbc-03ac-476b-b1eb-b583ec28cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4decdbc-03ac-476b-b1eb-b583ec28cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76182d20-8eea-4af1-aa46-c921a46e53fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76182d20-8eea-4af1-aa46-c921a46e53fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c73b608-111f-4323-80d1-1c886a70af06', 'volume_name': 'volume-4c73b608-111f-4323-80d1-1c886a70af06', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876720ad-bc63-4f46-af5a-1962fd3b2cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876720ad-bc63-4f46-af5a-1962fd3b2cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4477600a-f744-4c3a-8519-0f701f2b8998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume 4c73b608-111f-4323-80d1-1c886a70af06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c73b608-111f-4323-80d1-1c886a70af06', 'volume_size': 1}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.960s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:08:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1b74189b-ae53-44f4-8ea8-a9772d10f663 req-ee83caaf-b165-4d8c-a1de-3fe40a2347bb tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (500ba8b2-1dc5-40cd-895d-35d82334d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b98515-c57c-4f04-a8b7-097e919a30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25b98515-c57c-4f04-a8b7-097e919a30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279925759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7617637-ac39-4d27-925d-6a868dc8dfb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:15Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f542fc6-e650-4ad9-880c-af429fbf5606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f542fc6-e650-4ad9-880c-af429fbf5606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eda94fe-6564-4f24-84eb-2f312ea1ff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eda94fe-6564-4f24-84eb-2f312ea1ff7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7617637-ac39-4d27-925d-6a868dc8dfb8', 'volume_name': 'volume-f7617637-ac39-4d27-925d-6a868dc8dfb8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff1874a-e96b-438b-81aa-0fbdf239ec91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ff1874a-e96b-438b-81aa-0fbdf239ec91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ab6d44-64b3-4a36-a223-ec0357498498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:14 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume f7617637-ac39-4d27-925d-6a868dc8dfb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7617637-ac39-4d27-925d-6a868dc8dfb8', 'volume_size': 1}
Sep 04 06:08:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:16 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img" returned: 0 in 6.589s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[084803e5-7236-490d-aa93-908026041543]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:16 devstack sudo[102903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:08:16 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:17 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:08:17 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Converted 1024.00 MB image at 155.38 MB/s
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] fb44ea25-b2cb-4ad0-90a8-40c965d65549 was raw, converting to qcow2 {{(pid=87095) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae8157-be08-4d94-a2d3-d5103215f7ea]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:17 devstack sudo[102908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img
Sep 04 06:08:17 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:17 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:17 devstack sudo[102912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img
Sep 04 06:08:17 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:18 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img" returned: 1 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img /opt/stack/data/cinder/conversion/vol_upload_sscpso_e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:18 devstack sudo[102917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img /opt/stack/data/cinder/conversion/vol_upload_sscpso_e
Sep 04 06:08:18 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:18 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img /opt/stack/data/cinder/conversion/vol_upload_sscpso_e" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Image conversion details: src /opt/stack/data/cinder/conversion/aa4bc349-78e3-4462-a893-2d7eb33d61c8.temp_image.fb44ea25-b2cb-4ad0-90a8-40c965d655497celipuz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_sscpso_e {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:08:18 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d28022-5154-4500-9290-fec8d47c030e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sscpso_e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:18 devstack sudo[102922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sscpso_e
Sep 04 06:08:18 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:18 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_sscpso_e" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.745s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Uploaded volume to glance image-id: fb44ea25-b2cb-4ad0-90a8-40c965d65549. {{(pid=87095) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.067s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1702870476',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4342ebb3-790d-4fa5-9202-a0923c4974c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:10Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume 4342ebb3-790d-4fa5-9202-a0923c4974c7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:20 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 1073741824
Sep 04 06:08:20 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9531885c-8441-4162-831d-06710a66a820 tempest-VolumesActionsTest-1817783721 None] Copy volume to image completed successfully.
Sep 04 06:08:20 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 1073741824" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:20 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7
Sep 04 06:08:20 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:20 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.433s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576732284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e64912b-d9d0-404b-af68-381cdf90927f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:10Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume 1e64912b-d9d0-404b-af68-381cdf90927f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:20 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df276a8c-699a-4906-af02-4d87cede2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4342ebb3-790d-4fa5-9202-a0923c4974c7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:20 devstack sudo[102969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f 1073741824
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67879258-7427-4853-95a3-fe7aa54bf854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:20 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 (4342ebb3-790d-4fa5-9202-a0923c4974c7): created successfully
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67879258-7427-4853-95a3-fe7aa54bf854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (98e7a9c4-7100-4938-9ddb-fedb42c3c8c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7b790e7c-dc06-46b1-a6c7-f3d0939b4101 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:21 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f 1073741824" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:21 devstack sudo[102975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f
Sep 04 06:08:21 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:21 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.757s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361474414',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf2e187c-53b3-4d73-a691-2fb01d3a399e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:11Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume bf2e187c-53b3-4d73-a691-2fb01d3a399e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:21 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b3c9d2-105c-4144-bd3d-f148f4e87ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e64912b-d9d0-404b-af68-381cdf90927f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:21 devstack sudo[102978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e 1073741824
Sep 04 06:08:21 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c266ace-b463-4b2f-aa03-97a2085964a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-1e64912b-d9d0-404b-af68-381cdf90927f (1e64912b-d9d0-404b-af68-381cdf90927f): created successfully
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c266ace-b463-4b2f-aa03-97a2085964a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (19c8c301-6c24-4374-846c-7c6a005b93df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cb052658-66d3-47d7-a542-d99efc39668b tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Acquiring lock "cinder-quobyte-aa4bc349-78e3-4462-a893-2d7eb33d61c8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-quobyte-aa4bc349-78e3-4462-a893-2d7eb33d61c8" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f27c38-9590-465a-9b3d-b4ef3881543b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:22 devstack sudo[102984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:08:22 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:22 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e 1073741824" returned: 0 in 0.596s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:22 devstack sudo[102986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e
Sep 04 06:08:22 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:22 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:22 devstack sudo[102991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8
Sep 04 06:08:22 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:22 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.037s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-81058653',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73b608-111f-4323-80d1-1c886a70af06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:13Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume 4c73b608-111f-4323-80d1-1c886a70af06 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:22 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:22 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 1073741824
Sep 04 06:08:22 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf21ef4-70d4-4c6b-a993-5c11fde948a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5524d4-b42e-42a9-95ad-2fcd3ba44d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e (bf2e187c-53b3-4d73-a691-2fb01d3a399e): created successfully
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e5524d4-b42e-42a9-95ad-2fcd3ba44d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (876f876c-1023-4ddb-ade0-30187568cfca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b8942a1e-2894-4b7d-a56b-c23275ef9b94 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:22 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-aa4bc349-78e3-4462-a893-2d7eb33d61c8" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-quobyte-aa4bc349-78e3-4462-a893-2d7eb33d61c8" released by "delete_volume" :: held 0.728s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Created reservations ['3c86360a-61ef-498d-9a5f-eef4d24b3829', '726951ad-3583-4c3d-9b05-177a9ff67c6e', '01c6c788-4af3-400e-a144-1602033a5a0a', '36a0570d-b886-4f33-9c1f-41a27c75a603'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:22 devstack sudo[103000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:22 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:23 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 1073741824" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:23 devstack sudo[103003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06
Sep 04 06:08:23 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:23 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Deleted volume successfully.
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4cc71e28-0cc3-4a29-9746-958b9be0899f tempest-VolumesActionsTest-1817783721 None] Lock "cinder-aa4bc349-78e3-4462-a893-2d7eb33d61c8-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:23 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1b74189b-ae53-44f4-8ea8-a9772d10f663 req-ee83caaf-b165-4d8c-a1de-3fe40a2347bb tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.793s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4477600a-f744-4c3a-8519-0f701f2b8998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c73b608-111f-4323-80d1-1c886a70af06', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073ad83f-a190-4225-b668-945445929541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-1b74189b-ae53-44f4-8ea8-a9772d10f663 req-ee83caaf-b165-4d8c-a1de-3fe40a2347bb tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.550s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:08:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1279925759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7617637-ac39-4d27-925d-6a868dc8dfb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4edc2a5d5384ca28cd500f34fce9d64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:08:15Z,use_quota=True,user_id='448cadf326034d8da72bc464a7a92c98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Creating volume f7617637-ac39-4d27-925d-6a868dc8dfb8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:08:23 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:23 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-4c73b608-111f-4323-80d1-1c886a70af06 (4c73b608-111f-4323-80d1-1c886a70af06): created successfully
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073ad83f-a190-4225-b668-945445929541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:23 devstack sudo[103007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 1073741824
Sep 04 06:08:23 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (abe1b564-6cd7-4034-82c7-4bbd2cce1ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1a5b038e-ace4-40a4-8021-a34e71a4fc83 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:23 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-1b74189b-ae53-44f4-8ea8-a9772d10f663 req-ee83caaf-b165-4d8c-a1de-3fe40a2347bb tempest-TestInstancesWithCinderVolumes-1464211743 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-09b01c05-702c-41e9-8952-701cbc5e0eda', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '980a0519-dc14-45d5-abb8-36ac4bf2d114', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:08:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-1b74189b-ae53-44f4-8ea8-a9772d10f663 req-ee83caaf-b165-4d8c-a1de-3fe40a2347bb tempest-TestInstancesWithCinderVolumes-1464211743 None] attachment_update completed successfully.
Sep 04 06:08:24 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 1073741824" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:24 devstack sudo[103015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8
Sep 04 06:08:24 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:24 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ab6d44-64b3-4a36-a223-ec0357498498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7617637-ac39-4d27-925d-6a868dc8dfb8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a021a872-5054-4fc8-8e51-53dcf25065ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:08:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Volume volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 (f7617637-ac39-4d27-925d-6a868dc8dfb8): created successfully
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a021a872-5054-4fc8-8e51-53dcf25065ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Flow 'volume_create_manager' (500ba8b2-1dc5-40cd-895d-35d82334d031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:08:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bdaf3c44-3b24-4921-9db3-42a6b9f33f72 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created volume successfully.
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-f7617637-ac39-4d27-925d-6a868dc8dfb8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-f7617637-ac39-4d27-925d-6a868dc8dfb8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-f7617637-ac39-4d27-925d-6a868dc8dfb8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-f7617637-ac39-4d27-925d-6a868dc8dfb8" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac44b27-1daf-4fcf-b879-b114c22fa4f8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:24 devstack sudo[103026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8
Sep 04 06:08:24 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:25 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:25 devstack sudo[103032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8
Sep 04 06:08:25 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:25 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f7617637-ac39-4d27-925d-6a868dc8dfb8" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-f7617637-ac39-4d27-925d-6a868dc8dfb8" released by "delete_volume" :: held 0.782s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['206640e6-e96b-4b3c-95e8-93fa631c4bbb', 'b3fa2550-2515-4e69-954a-ef709f3fdfe6', '9e82b933-988b-4527-b6df-1efd64ba7a10', '78b2b498-9947-44d1-b1dd-41056d94ce44'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:25 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:25 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-4c73b608-111f-4323-80d1-1c886a70af06-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-4c73b608-111f-4323-80d1-1c886a70af06-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-4c73b608-111f-4323-80d1-1c886a70af06" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-4c73b608-111f-4323-80d1-1c886a70af06" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:26 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[91170bee-493b-470a-9698-a3d3233a29e9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62076a2-8cdb-4089-9ace-6eb44f0b177f tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-f7617637-ac39-4d27-925d-6a868dc8dfb8-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:26 devstack sudo[103038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06
Sep 04 06:08:26 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:26 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06" returned: 0 in 0.523s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:26 devstack sudo[103043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06
Sep 04 06:08:26 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:26 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4c73b608-111f-4323-80d1-1c886a70af06" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-4c73b608-111f-4323-80d1-1c886a70af06" released by "delete_volume" :: held 0.873s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['26ea0849-6ef7-4a6f-8aef-f838247174dd', '58c0996c-9fd6-442d-ac8a-80bbadfde7a2', '2461c7fb-cd82-4dc5-b9dc-9379f8a1b0e6', '55894ac6-4507-40c1-aeb4-0647c854ed0f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:27 devstack sudo[103048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:27 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-bf2e187c-53b3-4d73-a691-2fb01d3a399e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-bf2e187c-53b3-4d73-a691-2fb01d3a399e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-bf2e187c-53b3-4d73-a691-2fb01d3a399e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-bf2e187c-53b3-4d73-a691-2fb01d3a399e" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae4bdbb-187e-4470-850a-68d1942c5b17]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:27 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70c6fbf7-2abc-4891-ab21-8ce8366a57c0 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-4c73b608-111f-4323-80d1-1c886a70af06-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:27 devstack sudo[103055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e
Sep 04 06:08:27 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:28 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e" returned: 0 in 0.817s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:28 devstack sudo[103073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e
Sep 04 06:08:28 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:28 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bf2e187c-53b3-4d73-a691-2fb01d3a399e" returned: 0 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-bf2e187c-53b3-4d73-a691-2fb01d3a399e" released by "delete_volume" :: held 1.346s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['29e45e91-5059-4bd5-85b9-ffe5d4fe1122', 'b8a3df0f-7887-465f-be19-49b6afe44e90', '9bce434f-4771-4abd-b30a-4048b6bf0330', '809cdd16-7a03-456a-9101-478472d1b478'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:28 devstack sudo[103078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:28 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:29 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.392s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-99541e3a-a50b-4599-9d74-1880c0a017dc tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-bf2e187c-53b3-4d73-a691-2fb01d3a399e-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c1fff687-7302-41bb-8b05-23f140b73c40 req-d2def6fe-7dcc-4c11-8102-2a03a93a65ad tempest-TestInstancesWithCinderVolumes-1464211743 None] Terminate volume connection completed successfully.
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c1fff687-7302-41bb-8b05-23f140b73c40 req-d2def6fe-7dcc-4c11-8102-2a03a93a65ad tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleting attachment 3889b35b-fe4c-47e6-b29b-2d4f84ad2d47. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-1e64912b-d9d0-404b-af68-381cdf90927f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-1e64912b-d9d0-404b-af68-381cdf90927f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-1e64912b-d9d0-404b-af68-381cdf90927f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-1e64912b-d9d0-404b-af68-381cdf90927f" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c632656-b587-47a1-8b9a-066330c55dda]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:29 devstack sudo[103085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f
Sep 04 06:08:29 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-18552db7-13c2-4737-8eba-a42a677eb7d8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-18552db7-13c2-4737-8eba-a42a677eb7d8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-quobyte-18552db7-13c2-4737-8eba-a42a677eb7d8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-18552db7-13c2-4737-8eba-a42a677eb7d8" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e19012e-10fc-49d6-b843-f631a9731071]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:30 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f" returned: 0 in 0.501s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:30 devstack sudo[103094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f
Sep 04 06:08:30 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:30 devstack sudo[103093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8
Sep 04 06:08:30 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:30 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e64912b-d9d0-404b-af68-381cdf90927f" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-1e64912b-d9d0-404b-af68-381cdf90927f" released by "delete_volume" :: held 0.981s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:30 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8" returned: 0 in 0.617s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['5a8c8895-1c35-41cf-90f7-89cd493a0749', 'e457094a-8e5e-4595-93af-9ca25d83ca1f', '255a5e6f-42c4-44a2-8715-fa442217a026', 'a1bd75da-6d9d-4e51-b691-40f40a7fd7d9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:30 devstack sudo[103104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8
Sep 04 06:08:30 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:31 devstack sudo[103107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:31 devstack sudo[103107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:31 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-18552db7-13c2-4737-8eba-a42a677eb7d8" returned: 0 in 0.467s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-18552db7-13c2-4737-8eba-a42a677eb7d8" released by "delete_volume" :: held 1.156s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:31 devstack cinder-volume[87095]: WARNING cinder.quota [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-329975468-1815789222 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-329975468-1815789222, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:31 devstack cinder-volume[87095]: WARNING cinder.quota [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-329975468-1815789222 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-329975468-1815789222, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Created reservations ['5842e95c-a442-4097-84be-f8b0590092fa', '0c1039a1-9210-4660-914b-7ba8ae88dfaa', '850c23a7-9c9b-407b-a87e-0f69b76d5def', 'ea904559-f20f-486e-9d9c-3aa34d2df812'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:31 devstack sudo[103107]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.523s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:31 devstack sudo[103111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:31 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-023b594e-9887-409b-bb3c-48611b5b5040 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-1e64912b-d9d0-404b-af68-381cdf90927f-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:31 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleted volume successfully.
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5641a7d2-863e-43b7-88fd-c74570bb1bd3 tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-18552db7-13c2-4737-8eba-a42a677eb7d8-delete_volume" released by "delete_volume" :: held 1.892s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-4342ebb3-790d-4fa5-9202-a0923c4974c7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-4342ebb3-790d-4fa5-9202-a0923c4974c7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-4342ebb3-790d-4fa5-9202-a0923c4974c7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-4342ebb3-790d-4fa5-9202-a0923c4974c7" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bb43e6-06f9-49eb-9d2e-7e92cb73828a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:32 devstack sudo[103117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7
Sep 04 06:08:32 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:32 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7" returned: 0 in 0.594s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:32 devstack sudo[103122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7
Sep 04 06:08:32 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:33 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-4342ebb3-790d-4fa5-9202-a0923c4974c7" returned: 0 in 0.503s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-4342ebb3-790d-4fa5-9202-a0923c4974c7" released by "delete_volume" :: held 1.175s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-52e8038d-c600-4323-b44d-0d2d21a22ec1 req-d5f186ce-9033-4ab0-9eb7-d6941992197b tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-52e8038d-c600-4323-b44d-0d2d21a22ec1 req-d5f186ce-9033-4ab0-9eb7-d6941992197b tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-52e8038d-c600-4323-b44d-0d2d21a22ec1 req-d5f186ce-9033-4ab0-9eb7-d6941992197b tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-52e8038d-c600-4323-b44d-0d2d21a22ec1 req-d5f186ce-9033-4ab0-9eb7-d6941992197b tempest-TestServerVolumeAttachmentScenario-1377550275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-16c2b662-b04e-495e-947b-179ab131a5fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d2c1690-8e33-4ae3-83c4-a57d01460251', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['d1cf90b3-54da-4566-a223-f2576ee7337b', '24abc6bf-ed83-45e7-b5a9-3fbf870a5098', '913108d6-cb15-4606-b85c-bf161b9011d3', '5954a900-8973-4eb7-81bd-c8d76ce5f848'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-52e8038d-c600-4323-b44d-0d2d21a22ec1 req-d5f186ce-9033-4ab0-9eb7-d6941992197b tempest-TestServerVolumeAttachmentScenario-1377550275 None] attachment_update completed successfully.
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:33 devstack sudo[103143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:33 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:33 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d071e3a8-a372-499e-a0a3-1d2873496474 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-4342ebb3-790d-4fa5-9202-a0923c4974c7-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-12479b42-0a80-4b1e-a8a7-0003cdc3e781-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-12479b42-0a80-4b1e-a8a7-0003cdc3e781-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "cinder-quobyte-12479b42-0a80-4b1e-a8a7-0003cdc3e781" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-12479b42-0a80-4b1e-a8a7-0003cdc3e781" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6856c60b-fc95-4202-8ba2-41443ee746a3]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:34 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781
Sep 04 06:08:34 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:35 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781" returned: 0 in 0.486s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:35 devstack sudo[103165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781
Sep 04 06:08:35 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-37e70b25-011e-4357-ae7f-e33681095554 req-a479fa94-4d08-4ee0-939b-1a3c318c9c47 tempest-TestInstancesWithCinderVolumes-1464211743 None] Terminate volume connection completed successfully.
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-37e70b25-011e-4357-ae7f-e33681095554 req-a479fa94-4d08-4ee0-939b-1a3c318c9c47 tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleting attachment 980a0519-dc14-45d5-abb8-36ac4bf2d114. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:08:35 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12479b42-0a80-4b1e-a8a7-0003cdc3e781" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-quobyte-12479b42-0a80-4b1e-a8a7-0003cdc3e781" released by "delete_volume" :: held 0.966s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Created reservations ['6fe9ded8-514a-48d7-910b-269f25f36c91', 'bd5637b8-6c9c-4b6c-9aa8-e2180c710342', 'f5288ed2-9c0a-4747-9fd5-cfd4ef0bf810', 'b3c71c30-8b20-4dfc-a605-1c48a3065f2f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:35 devstack sudo[103204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:35 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:36 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Deleted volume successfully.
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-09b01c05-702c-41e9-8952-701cbc5e0eda-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-049725e1-1adc-4f53-b8e5-690e5ac13a11 tempest-CreateVolumesFromSourceVolumeTest-797787512 None] Lock "cinder-12479b42-0a80-4b1e-a8a7-0003cdc3e781-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-09b01c05-702c-41e9-8952-701cbc5e0eda-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-quobyte-09b01c05-702c-41e9-8952-701cbc5e0eda" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-09b01c05-702c-41e9-8952-701cbc5e0eda" acquired by "delete_volume" :: waited 0.043s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c30e64b-d154-418c-a0ae-e93475797644]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:36 devstack sudo[103209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda
Sep 04 06:08:36 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:36 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:36 devstack sudo[103214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda
Sep 04 06:08:36 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:37 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-09b01c05-702c-41e9-8952-701cbc5e0eda" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-09b01c05-702c-41e9-8952-701cbc5e0eda" released by "delete_volume" :: held 1.016s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:37 devstack cinder-volume[87095]: WARNING cinder.quota [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105176078-241857762 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105176078-241857762, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:37 devstack cinder-volume[87095]: WARNING cinder.quota [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105176078-241857762 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-105176078-241857762, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Created reservations ['84155c00-2255-49f3-ba9c-58fe56db1bd2', '150c8a7c-bf11-4000-8af2-4c77bf73a779', '6f3c0573-c1ce-4e5b-b85b-d663bc767aad', 'bd5ad123-dd5b-49a4-a6b7-31b4440a28b4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:37 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:37 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:37 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleted volume successfully.
Sep 04 06:08:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0a1c1351-5d24-43d4-b9d6-48e5cc233bee tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-09b01c05-702c-41e9-8952-701cbc5e0eda-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c2257afa-338b-456c-8ddf-fa4aae7b11f2 req-2bb15f80-1821-4173-a758-e6d9e40abfa4 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c2257afa-338b-456c-8ddf-fa4aae7b11f2 req-2bb15f80-1821-4173-a758-e6d9e40abfa4 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-c2257afa-338b-456c-8ddf-fa4aae7b11f2 req-2bb15f80-1821-4173-a758-e6d9e40abfa4 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-c2257afa-338b-456c-8ddf-fa4aae7b11f2 req-2bb15f80-1821-4173-a758-e6d9e40abfa4 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4670529e-bafe-4548-8437-a3daeece581b', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:08:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-c2257afa-338b-456c-8ddf-fa4aae7b11f2 req-2bb15f80-1821-4173-a758-e6d9e40abfa4 tempest-TestServerVolumeAttachmentScenario-1377550275 None] attachment_update completed successfully.
Sep 04 06:08:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-7aadd228-ffbf-42e2-a59e-036d2547c744 req-adb51f19-1c34-4509-8bf4-c76a15d52d69 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Terminate volume connection completed successfully.
Sep 04 06:08:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-7aadd228-ffbf-42e2-a59e-036d2547c744 req-adb51f19-1c34-4509-8bf4-c76a15d52d69 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Deleting attachment 4670529e-bafe-4548-8437-a3daeece581b. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:08:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-02afb1da-9f96-45dc-9b30-87d4c922f9a7 req-aee73a2b-b47a-4097-b1d1-841c8ff11b09 tempest-TestInstancesWithCinderVolumes-1464211743 None] Terminate volume connection completed successfully.
Sep 04 06:08:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-02afb1da-9f96-45dc-9b30-87d4c922f9a7 req-aee73a2b-b47a-4097-b1d1-841c8ff11b09 tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleting attachment b8c86b33-8eae-4929-b8f9-beac1588c11c. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:08:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-80cfdbda-552e-4bb4-a56c-d572f0a77d51 req-2de92ad1-9328-4013-8262-a8c9988512f2 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Terminate volume connection completed successfully.
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-80cfdbda-552e-4bb4-a56c-d572f0a77d51 req-2de92ad1-9328-4013-8262-a8c9988512f2 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Deleting attachment 8d2c1690-8e33-4ae3-83c4-a57d01460251. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-fdcde8cc-b5b1-469e-8b5c-91137af01291-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-fdcde8cc-b5b1-469e-8b5c-91137af01291-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=101,cinder:SELECT=89,cinder:INSERT=21,cinder:DELETE=9 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=102,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "cinder-quobyte-fdcde8cc-b5b1-469e-8b5c-91137af01291" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-fdcde8cc-b5b1-469e-8b5c-91137af01291" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfdabf6-5c6b-4153-ae84-daa97a1c1545]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:44 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291
Sep 04 06:08:44 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:45 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:45 devstack sudo[103271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291
Sep 04 06:08:45 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:45 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-fdcde8cc-b5b1-469e-8b5c-91137af01291" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-quobyte-fdcde8cc-b5b1-469e-8b5c-91137af01291" released by "delete_volume" :: held 0.881s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:45 devstack cinder-volume[87095]: WARNING cinder.quota [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1986025949-822810468 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1986025949-822810468, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:45 devstack cinder-volume[87095]: WARNING cinder.quota [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1986025949-822810468 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1986025949-822810468, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Created reservations ['27cd8613-509f-49a0-a5cb-84da6d6d1069', 'e2c7b2a5-3b09-4f05-9498-54c0d6e13244', 'cc90d785-7f92-4157-a739-d124e62000f4', '1059fb34-72dd-485a-a1cd-6e5f5e93de38'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:45 devstack sudo[103294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:45 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:46 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Deleted volume successfully.
Sep 04 06:08:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ab720ad1-a894-4296-95f5-5dcde5231b0c tempest-TestInstancesWithCinderVolumes-1464211743 None] Lock "cinder-fdcde8cc-b5b1-469e-8b5c-91137af01291-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "cinder-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "cinder-quobyte-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-quobyte-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[23077692-229d-4d64-a0d5-a4c175ef2b3d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:53 devstack sudo[103309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f
Sep 04 06:08:53 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:53 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:53 devstack sudo[103315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f
Sep 04 06:08:53 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:54 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" returned: 0 in 0.363s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-quobyte-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f" released by "delete_volume" :: held 0.920s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Created reservations ['b0bff37d-b811-497a-9cc9-7eede12300b9', 'a331ee99-b1db-4e36-8c46-1fcd4e544283', '8f01e028-60a6-42b7-840c-b2e8be89d502', 'b9a548c5-9e28-4006-9f46-77aceea9a157'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:54 devstack sudo[103318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:54 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:54 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Deleted volume successfully.
Sep 04 06:08:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-416d4efd-9471-446b-bdfc-c895409ebc92 tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-b1ec868e-62fa-4ce8-a3b7-cbfce23e387f-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "cinder-16c2b662-b04e-495e-947b-179ab131a5fd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-16c2b662-b04e-495e-947b-179ab131a5fd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "cinder-quobyte-16c2b662-b04e-495e-947b-179ab131a5fd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-quobyte-16c2b662-b04e-495e-947b-179ab131a5fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee141ccb-909b-4e03-a40b-b1be03324c3c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:08:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:55 devstack sudo[103321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd
Sep 04 06:08:55 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:56 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:56 devstack sudo[103326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd
Sep 04 06:08:56 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:56 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-16c2b662-b04e-495e-947b-179ab131a5fd" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-quobyte-16c2b662-b04e-495e-947b-179ab131a5fd" released by "delete_volume" :: held 0.869s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Created reservations ['92e8e4aa-8392-4055-b35b-6b0accb9d05a', 'be27d1f4-a177-42b8-816b-83d4b3754a6e', 'df8cd759-a451-4426-b00b-8375dc97ab14', 'f7edbc5d-5598-4cdf-ac9e-76ecf2bd995c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:08:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:08:56 devstack sudo[103329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:08:56 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:08:57 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root
Sep 04 06:08:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:08:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:08:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Deleted volume successfully.
Sep 04 06:08:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6713c959-4d4c-406e-8cb9-2a9fa4d5c0cf tempest-TestServerVolumeAttachmentScenario-1377550275 None] Lock "cinder-16c2b662-b04e-495e-947b-179ab131a5fd-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:06 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=16,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Flow 'volume_create_manager' (4f3c72df-920b-4403-936d-378d5bd55b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0330e887-25e5-4f40-a7b7-cf6e30bacac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0330e887-25e5-4f40-a7b7-cf6e30bacac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-848784308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b8b40-6355-4ff8-8aea-c348264b944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c33136334ec4265881899c341bf9995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:08Z,use_quota=True,user_id='f0d680183d8a4b9bbc222dc0f645500c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d55808-96d4-4242-ad2a-980a4c418bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d55808-96d4-4242-ad2a-980a4c418bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fec6bcb-2ad1-490a-af71-c786f008a85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fec6bcb-2ad1-490a-af71-c786f008a85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320b8b40-6355-4ff8-8aea-c348264b944d', 'volume_name': 'volume-320b8b40-6355-4ff8-8aea-c348264b944d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff977bf-467d-46ba-9e86-e7f0d817fb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff977bf-467d-46ba-9e86-e7f0d817fb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84de332e-c98b-4e67-8f8d-9fb0c8d72a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Volume 320b8b40-6355-4ff8-8aea-c348264b944d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320b8b40-6355-4ff8-8aea-c348264b944d', 'volume_size': 1}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-848784308',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320b8b40-6355-4ff8-8aea-c348264b944d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c33136334ec4265881899c341bf9995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:08Z,use_quota=True,user_id='f0d680183d8a4b9bbc222dc0f645500c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Creating volume 320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:07 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:07 devstack sudo[103338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d 1073741824
Sep 04 06:09:07 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:08 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d 1073741824" returned: 0 in 0.680s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:08 devstack sudo[103345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:09:08 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:08 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84de332e-c98b-4e67-8f8d-9fb0c8d72a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320b8b40-6355-4ff8-8aea-c348264b944d', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4a1e16-db4d-4a60-9321-d8beb04458aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Volume volume-320b8b40-6355-4ff8-8aea-c348264b944d (320b8b40-6355-4ff8-8aea-c348264b944d): created successfully
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff4a1e16-db4d-4a60-9321-d8beb04458aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Flow 'volume_create_manager' (4f3c72df-920b-4403-936d-378d5bd55b9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14725ec3-1144-40c3-8f14-9f2d6744f4d3 tempest-TestStampPattern-1733924651 None] Created volume successfully.
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:12 devstack sudo[103373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:09:12 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:12 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:09:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:09:18 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Flow 'volume_create_manager' (3f4a5e9e-4520-4de0-8dfe-eea4fcc47352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db469ed8-7f32-41df-8e57-ff5d7edbafee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db469ed8-7f32-41df-8e57-ff5d7edbafee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b385caf0-3b4b-4cec-8b93-d9bbb1205cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfbab8a83f34ba0838c505199ebb32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:21Z,use_quota=True,user_id='6e0b8dddd5684e8d9561ab0a70eeeaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8e743-431c-4f6e-a9a4-4c1e55d4e924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c8e743-431c-4f6e-a9a4-4c1e55d4e924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93106bd1-a3c3-4910-b26b-97cea2f0903c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:20 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93106bd1-a3c3-4910-b26b-97cea2f0903c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b385caf0-3b4b-4cec-8b93-d9bbb1205cd6', 'volume_name': 'volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6', 'volume_size': 1, 'image_id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ef7f359aad59179d95100942430b636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cfbab8a83f34ba0838c505199ebb32b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '148ecaca7117a40739941ed105f4144959d68a7d1c1d184b556027e31902caab19fb69ded5c1bcc895b37fbb134bc0734d20d1aced6d16b93c7d4a4df159acab', 'id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e14071-b288-4b23-9692-4b5da0cefcb9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1460>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3be7a-23e8-4452-80ac-800f3622f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ca3be7a-23e8-4452-80ac-800f3622f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4534ee7-4130-4a3a-9095-0eee3957e91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6', 'volume_size': 1, 'image_id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ef7f359aad59179d95100942430b636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cfbab8a83f34ba0838c505199ebb32b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '148ecaca7117a40739941ed105f4144959d68a7d1c1d184b556027e31902caab19fb69ded5c1bcc895b37fbb134bc0734d20d1aced6d16b93c7d4a4df159acab', 'id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e14071-b288-4b23-9692-4b5da0cefcb9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1460>}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Trying to clone b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 from image 02e14071-b288-4b23-9692-4b5da0cefcb9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:09:21 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6d77ae-a8d6-49b1-8a0a-743007aa7382]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:21 devstack sudo[103457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:21 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:22 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 0 in 0.581s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:22 devstack sudo[103461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:22 devstack sudo[103461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:22 devstack sudo[103461]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 1 in 0.494s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Temporary image 02e14071-b288-4b23-9692-4b5da0cefcb9 is fetched for user 6e0b8dddd5684e8d9561ab0a70eeeaa4. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec80ea-6860-4aeb-b68e-c17c260ecf68]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:23 devstack sudo[103466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:23 devstack sudo[103466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:23 devstack sudo[103466]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:23 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:23 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:23 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 1 in 0.540s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b385caf0-3b4b-4cec-8b93-d9bbb1205cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cfbab8a83f34ba0838c505199ebb32b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:21Z,use_quota=True,user_id='6e0b8dddd5684e8d9561ab0a70eeeaa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Creating volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:23 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:23 devstack sudo[103475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1073741824
Sep 04 06:09:23 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:24 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1073741824" returned: 0 in 0.626s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:24 devstack sudo[103481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6
Sep 04 06:09:24 devstack sudo[103481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:24 devstack sudo[103481]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:25 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Attempting download of 02e14071-b288-4b23-9692-4b5da0cefcb9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}])) to volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:09:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64cc22f-f242-4dcf-b404-c6f1ead10122]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:25 devstack sudo[103484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7
Sep 04 06:09:25 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:25 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7" returned: 0 in 0.595s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:25 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7
Sep 04 06:09:25 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:26 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7" returned: 1 in 0.480s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_02e14071-b288-4b23-9692-4b5da0cefcb9_9340i5v7' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a73931c-b506-49d9-af92-818098f6e2c8]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:26 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:26 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:26 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 0 in 0.609s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:26 devstack sudo[103496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD
Sep 04 06:09:26 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:27 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD" returned: 1 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] 02e14071-b288-4b23-9692-4b5da0cefcb9 was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:27 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6
Sep 04 06:09:27 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:27 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" returned: 0 in 0.607s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_02e14071-b288-4b23-9692-4b5da0cefcb9_24i1_q77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:09:27 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 06:09:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:27 devstack sudo[103508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1G
Sep 04 06:09:27 devstack sudo[103508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:28 devstack sudo[103508]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 1G" returned: 0 in 0.498s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Downloaded image 02e14071-b288-4b23-9692-4b5da0cefcb9 ((None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}])) to volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Temporary image 02e14071-b288-4b23-9692-4b5da0cefcb9 for user 6e0b8dddd5684e8d9561ab0a70eeeaa4 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Marking volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Copying metadata from image 02e14071-b288-4b23-9692-4b5da0cefcb9 to b385caf0-3b4b-4cec-8b93-d9bbb1205cd6. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Creating volume glance metadata for volume b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 backed by image 02e14071-b288-4b23-9692-4b5da0cefcb9 with: {'image_id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7ef7f359aad59179d95100942430b636', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4534ee7-4130-4a3a-9095-0eee3957e91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6', 'volume_size': 1, 'image_id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/02e14071-b288-4b23-9692-4b5da0cefcb9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7ef7f359aad59179d95100942430b636', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3cfbab8a83f34ba0838c505199ebb32b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '148ecaca7117a40739941ed105f4144959d68a7d1c1d184b556027e31902caab19fb69ded5c1bcc895b37fbb134bc0734d20d1aced6d16b93c7d4a4df159acab', 'id': '02e14071-b288-4b23-9692-4b5da0cefcb9', 'created_at': datetime.datetime(2026, 9, 4, 4, 9, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 9, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/02e14071-b288-4b23-9692-4b5da0cefcb9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1460>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c0765a-f2e9-48e8-bcad-290e8eff2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:28 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Volume volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 (b385caf0-3b4b-4cec-8b93-d9bbb1205cd6): created successfully
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c0765a-f2e9-48e8-bcad-290e8eff2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Flow 'volume_create_manager' (3f4a5e9e-4520-4de0-8dfe-eea4fcc47352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-33a0b865-8f91-495f-8e2b-5820ab197afd tempest-VolumeImageDependencyTests-459277452 None] Created volume successfully.
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Acquiring lock "cinder-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "cinder-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Acquiring lock "cinder-quobyte-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "cinder-quobyte-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc491d6-45ab-445b-801d-18e4184fc8b8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:29 devstack sudo[103535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6
Sep 04 06:09:29 devstack sudo[103535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:30 devstack sudo[103535]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" returned: 0 in 0.499s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:30 devstack sudo[103540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6
Sep 04 06:09:30 devstack sudo[103540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:30 devstack sudo[103540]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "cinder-quobyte-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6" released by "delete_volume" :: held 0.836s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Created reservations ['aeabfea1-42dd-4883-a14c-fdb36300d215', 'df84f8de-5205-4eeb-a89e-8fee1694b49b', 'cc2d611f-dc19-4769-b82c-4f8c154544ea', 'd53e524a-44ad-4f08-8adc-e7b159e8ed47'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:30 devstack sudo[103543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:09:30 devstack sudo[103543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:30 devstack sudo[103543]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:09:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Deleted volume successfully.
Sep 04 06:09:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-35988c10-ee8c-4dce-908f-ad8449a573dc tempest-VolumeImageDependencyTests-459277452 None] Lock "cinder-b385caf0-3b4b-4cec-8b93-d9bbb1205cd6-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Flow 'volume_create_manager' (614a2269-2ae0-4f60-959b-b0a07dd5003c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93173c0-2d23-4621-90d7-dfdc0e1cb49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c93173c0-2d23-4621-90d7-dfdc0e1cb49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6307db1-5bb3-4c11-8bf7-2c039f20c5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf9e56a025348c7b6aff6c465887aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:35Z,use_quota=True,user_id='a53e0d6306d948d5881514aeb0f951fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253d86c-18bd-46f6-8a8a-2f217e3bad47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7253d86c-18bd-46f6-8a8a-2f217e3bad47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a15027-e4d3-44b1-a583-3061dbc8f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a15027-e4d3-44b1-a583-3061dbc8f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6307db1-5bb3-4c11-8bf7-2c039f20c5af', 'volume_name': 'volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75993690-87b5-4b68-a77e-0f534fa26ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75993690-87b5-4b68-a77e-0f534fa26ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55207984-d300-4b6e-84b8-61d4ae4d20ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Volume a6307db1-5bb3-4c11-8bf7-2c039f20c5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af', 'volume_size': 1}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6307db1-5bb3-4c11-8bf7-2c039f20c5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf9e56a025348c7b6aff6c465887aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:35Z,use_quota=True,user_id='a53e0d6306d948d5881514aeb0f951fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Creating volume a6307db1-5bb3-4c11-8bf7-2c039f20c5af {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:34 devstack sudo[103548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af 1073741824
Sep 04 06:09:34 devstack sudo[103548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:35 devstack sudo[103548]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af 1073741824" returned: 0 in 0.560s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:35 devstack sudo[103554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af
Sep 04 06:09:35 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:35 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55207984-d300-4b6e-84b8-61d4ae4d20ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d3587-7c4a-4f6a-b807-3fc44695f524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Volume volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af (a6307db1-5bb3-4c11-8bf7-2c039f20c5af): created successfully
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44d3587-7c4a-4f6a-b807-3fc44695f524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Flow 'volume_create_manager' (614a2269-2ae0-4f60-959b-b0a07dd5003c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-99e3c1d3-b0ef-4c46-b4c8-7bc216d35b40 tempest-CinderUnicodeTest-729416530 None] Created volume successfully.
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Flow 'volume_create_manager' (b36b6b51-f7ad-46e1-bf4f-14b8c72330e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91fc18-0b69-4fef-a722-794dbd52ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c91fc18-0b69-4fef-a722-794dbd52ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1699875318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d7b1b5-349d-41cb-baa9-0e085b35594a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf9e56a025348c7b6aff6c465887aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:38Z,use_quota=True,user_id='a53e0d6306d948d5881514aeb0f951fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13948f19-75af-4a53-8cef-47c84aa16d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13948f19-75af-4a53-8cef-47c84aa16d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3ec6a-cd47-4e69-938d-f6923dc3133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3ec6a-cd47-4e69-938d-f6923dc3133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d7b1b5-349d-41cb-baa9-0e085b35594a', 'volume_name': 'volume-30d7b1b5-349d-41cb-baa9-0e085b35594a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b84722-474b-46b1-b47c-bb51b1004977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b84722-474b-46b1-b47c-bb51b1004977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be444ba-da36-4533-85ad-cc5993e62cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Volume 30d7b1b5-349d-41cb-baa9-0e085b35594a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d7b1b5-349d-41cb-baa9-0e085b35594a', 'volume_size': 1}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1699875318',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d7b1b5-349d-41cb-baa9-0e085b35594a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbf9e56a025348c7b6aff6c465887aa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:38Z,use_quota=True,user_id='a53e0d6306d948d5881514aeb0f951fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Creating volume 30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:37 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:37 devstack sudo[103593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a 1073741824
Sep 04 06:09:37 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:38 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a 1073741824" returned: 0 in 0.619s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:38 devstack sudo[103599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a
Sep 04 06:09:38 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:38 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0be444ba-da36-4533-85ad-cc5993e62cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d7b1b5-349d-41cb-baa9-0e085b35594a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacc89df-a639-4dc7-be50-bd6ed777bcb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Volume volume-30d7b1b5-349d-41cb-baa9-0e085b35594a (30d7b1b5-349d-41cb-baa9-0e085b35594a): created successfully
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dacc89df-a639-4dc7-be50-bd6ed777bcb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Flow 'volume_create_manager' (b36b6b51-f7ad-46e1-bf4f-14b8c72330e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2f486082-2bb4-4423-91de-954f2e9ac32f tempest-CinderUnicodeTest-729416530 None] Created volume successfully.
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Creating offline snapshot add7c54a-005d-478d-89c7-24c228467d44 of volume 30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1ca373-2edc-420e-8e38-ad9ea4d35993]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:40 devstack sudo[103609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a
Sep 04 06:09:40 devstack sudo[103609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8bf6d420-8032-4f45-a306-267111c158fb req-fe734e77-0680-44ba-9317-8e848a71e41e tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:40 devstack sudo[103609]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a" returned: 0 in 0.547s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:40 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 1G
Sep 04 06:09:40 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:41 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 1G" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7b1b5-349d-41cb-baa9-0e085b35594a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:41 devstack sudo[103629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7b1b5-349d-41cb-baa9-0e085b35594a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:41 devstack sudo[103629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Flow 'volume_create_manager' (77c84dc0-9625-4f9e-88cc-b85c41430af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83c809a-cafc-49a3-be9a-4c8ab405e24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d83c809a-cafc-49a3-be9a-4c8ab405e24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1752391624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae6524-1056-4ed5-8544-9e72c192cfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031dab0fdbff4f76b577a2bcd74170d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:41Z,use_quota=True,user_id='a6a8e3d7fecc4e79ac8aeb06f6b040d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad890f2-6737-4be1-8c4f-3d148a9398ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bad890f2-6737-4be1-8c4f-3d148a9398ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cf0b5b-a28d-4665-9bb1-5e71e675c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:09:41 devstack sudo[103629]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d7b1b5-349d-41cb-baa9-0e085b35594a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44" returned: 0 in 0.322s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 is being set with open permissions: ugo+rw
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:41 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44
Sep 04 06:09:41 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:41 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:41 devstack sudo[103637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info
Sep 04 06:09:41 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90cf0b5b-a28d-4665-9bb1-5e71e675c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5ae6524-1056-4ed5-8544-9e72c192cfe1', 'volume_name': 'volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1310>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053297b3-3b27-4dcf-a883-b16c78658e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (053297b3-3b27-4dcf-a883-b16c78658e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f088c-ff26-4387-b875-187da467a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Volume d5ae6524-1056-4ed5-8544-9e72c192cfe1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1310>}
Sep 04 06:09:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Trying to clone d5ae6524-1056-4ed5-8544-9e72c192cfe1 from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:09:42 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:42 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info is being set with open permissions: ugo+rw
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:42 devstack sudo[103640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info
Sep 04 06:09:42 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:09:42 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Image download 20.69 MB at 20.69 MB/s
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42d44c3-de9c-4a2c-8cb8-cafefafc7281]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:42 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.info" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:42 devstack sudo[103643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD
Sep 04 06:09:42 devstack sudo[103643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.355s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8bf6d420-8032-4f45-a306-267111c158fb req-fe734e77-0680-44ba-9317-8e848a71e41e tempest-TestStampPattern-1733924651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.885s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-8bf6d420-8032-4f45-a306-267111c158fb req-fe734e77-0680-44ba-9317-8e848a71e41e tempest-TestStampPattern-1733924651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e91b21d0-a701-443d-ad9d-d8395cd3db6f tempest-CinderUnicodeTest-729416530 None] Create snapshot completed successfully
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-8bf6d420-8032-4f45-a306-267111c158fb req-fe734e77-0680-44ba-9317-8e848a71e41e tempest-TestStampPattern-1733924651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-320b8b40-6355-4ff8-8aea-c348264b944d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7c41bbd-052c-4d0a-b06e-3e16488bf1cd', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:09:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-8bf6d420-8032-4f45-a306-267111c158fb req-fe734e77-0680-44ba-9317-8e848a71e41e tempest-TestStampPattern-1733924651 None] attachment_update completed successfully.
Sep 04 06:09:42 devstack sudo[103643]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 is fetched for user a6a8e3d7fecc4e79ac8aeb06f6b040d9. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a46af3-68fd-4db0-9e86-c7103a55aa87]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:42 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD
Sep 04 06:09:42 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:43 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1752391624',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5ae6524-1056-4ed5-8544-9e72c192cfe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031dab0fdbff4f76b577a2bcd74170d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:41Z,use_quota=True,user_id='a6a8e3d7fecc4e79ac8aeb06f6b040d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Creating volume d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:43 devstack sudo[104036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1073741824
Sep 04 06:09:43 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-add7c54a-005d-478d-89c7-24c228467d44-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-add7c54a-005d-478d-89c7-24c228467d44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-quobyte-add7c54a-005d-478d-89c7-24c228467d44" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-add7c54a-005d-478d-89c7-24c228467d44" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Deleting offline snapshot add7c54a-005d-478d-89c7-24c228467d44 of volume 30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] snapshot_file for this snap is: volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bf31a4-f1e9-4f47-9e75-cd535ffc34ca]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:43 devstack sudo[104041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44
Sep 04 06:09:43 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:43 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1073741824" returned: 0 in 0.523s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:43 devstack sudo[104049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1
Sep 04 06:09:43 devstack sudo[104049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:43 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d7b1b5-349d-41cb-baa9-0e085b35594a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[20687994-d4d7-40c5-9d12-deb66371c99d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:43 devstack sudo[104049]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:43 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Attempting download of c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume d5ae6524-1056-4ed5-8544-9e72c192cfe1. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:09:44 devstack sudo[104060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a
Sep 04 06:09:44 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[89357eeb-d5fb-4624-8bef-4b32e7684853]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:44 devstack sudo[104062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy
Sep 04 06:09:44 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:44 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:44 devstack sudo[104067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44
Sep 04 06:09:44 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:44 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:44 devstack sudo[104071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy
Sep 04 06:09:44 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:44 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:44 devstack sudo[104077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44
Sep 04 06:09:44 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:44 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy" returned: 1 in 0.357s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1c4afc1-734f-46ce-9589-8a0fba4d2421_lbkh22vy' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78fcb5-d20c-4235-9457-2a679bb3e7b0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:44 devstack sudo[104080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD
Sep 04 06:09:44 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:45 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a.add7c54a-005d-478d-89c7-24c228467d44" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-add7c54a-005d-478d-89c7-24c228467d44" released by "_delete_snapshot" :: held 1.705s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" released by "delete_snapshot" :: held 1.738s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:45 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] c1c4afc1-734f-46ce-9589-8a0fba4d2421 was qcow2, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:45 devstack sudo[104086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1
Sep 04 06:09:45 devstack sudo[104086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Created reservations ['8235dbd5-1605-4869-a144-d017c4876751', 'a2bd1ec9-ddd3-4f59-9ebb-3f678689c50f', 'af246abb-b36a-4229-9c9b-5dae4c7e2f00', '4261209f-ae71-43ac-bce5-9342a8cb44e0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:09:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Delete snapshot completed successfully.
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42c2d0ad-a2e5-4f5e-816f-8d4d16af2772 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-add7c54a-005d-478d-89c7-24c228467d44-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-30d7b1b5-349d-41cb-baa9-0e085b35594a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-30d7b1b5-349d-41cb-baa9-0e085b35594a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d1441-5617-4517-ba61-985b92a9cd8d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:45 devstack sudo[104097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a
Sep 04 06:09:45 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:46 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a" returned: 0 in 0.439s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:46 devstack sudo[104107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a
Sep 04 06:09:46 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:46 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-30d7b1b5-349d-41cb-baa9-0e085b35594a" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-30d7b1b5-349d-41cb-baa9-0e085b35594a" released by "delete_volume" :: held 0.829s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Created reservations ['eb278b8e-1019-48cb-95cf-3f1f71bd0066', '2ec6e6e4-d188-4ad9-adb0-8b0bc6a6e21e', 'e66b3b85-719a-4eda-abda-1111e4962446', '46cd46ad-6769-4f8d-80ee-651a46fd1cae'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:46 devstack sudo[104118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:09:46 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-a6307db1-5bb3-4c11-8bf7-2c039f20c5af-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "cinder-a6307db1-5bb3-4c11-8bf7-2c039f20c5af-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "cinder-quobyte-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1522abf-2cd7-41ba-807d-683e9f431535]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:47 devstack sudo[104120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af
Sep 04 06:09:47 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:47 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:09:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Deleted volume successfully.
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f9ef1cb3-583e-4eb4-897a-09f1658a7459 tempest-CinderUnicodeTest-729416530 None] Lock "cinder-30d7b1b5-349d-41cb-baa9-0e085b35594a-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-6d7b5cf9-d22e-43c6-816e-020ac7dac44a req-c51c6973-b016-4514-8537-c588b1c280fa tempest-TestStampPattern-1733924651 None] Terminate volume connection completed successfully.
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-6d7b5cf9-d22e-43c6-816e-020ac7dac44a req-c51c6973-b016-4514-8537-c588b1c280fa tempest-TestStampPattern-1733924651 None] Deleting attachment a7c41bbd-052c-4d0a-b06e-3e16488bf1cd. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:09:47 devstack sudo[104086]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1" returned: 0 in 2.233s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1c4afc1-734f-46ce-9589-8a0fba4d2421_fhsqd1_ydevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:09:47 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Converted 112.00 MB image at 50.13 MB/s
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:47 devstack sudo[104153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1G
Sep 04 06:09:47 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:47 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:47 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af
Sep 04 06:09:47 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:47 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "cinder-quobyte-a6307db1-5bb3-4c11-8bf7-2c039f20c5af" released by "delete_volume" :: held 0.832s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:47 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 1G" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Downloaded image c1c4afc1-734f-46ce-9589-8a0fba4d2421 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}])) to volume d5ae6524-1056-4ed5-8544-9e72c192cfe1 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Temporary image c1c4afc1-734f-46ce-9589-8a0fba4d2421 for user a6a8e3d7fecc4e79ac8aeb06f6b040d9 is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Marking volume d5ae6524-1056-4ed5-8544-9e72c192cfe1 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Created reservations ['b9e832ef-47e9-420f-82b7-2bb7b00b96fd', '84303108-8efb-4bbd-92c7-a0a0f247d018', 'f8c43bd9-389e-4d7f-a0bd-5f2469df24ae', '92c97c2a-fa19-4810-b94e-a79f617942fa'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Copying metadata from image c1c4afc1-734f-46ce-9589-8a0fba4d2421 to d5ae6524-1056-4ed5-8544-9e72c192cfe1. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Creating volume glance metadata for volume d5ae6524-1056-4ed5-8544-9e72c192cfe1 backed by image c1c4afc1-734f-46ce-9589-8a0fba4d2421 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:47 devstack sudo[104168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:09:47 devstack sudo[104168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (942f088c-ff26-4387-b875-187da467a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1', 'volume_size': 1, 'image_id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b1018d5d6cf455a90d139e10e7c5e59', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c1c4afc1-734f-46ce-9589-8a0fba4d2421', 'created_at': datetime.datetime(2026, 9, 4, 3, 48, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 3, 48, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1c4afc1-734f-46ce-9589-8a0fba4d2421/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e7d1310>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be2dd50-7869-4d33-af60-19679ef029b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Volume volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 (d5ae6524-1056-4ed5-8544-9e72c192cfe1): created successfully
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be2dd50-7869-4d33-af60-19679ef029b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Flow 'volume_create_manager' (77c84dc0-9625-4f9e-88cc-b85c41430af3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-74251170-f1f6-43d6-b6b9-403ebcb6d7d6 tempest-TestShelveInstance-24213871 None] Created volume successfully.
Sep 04 06:09:48 devstack sudo[104168]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.310s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:09:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Deleted volume successfully.
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1ca046c8-c578-41b8-944f-26b0765bfd6f tempest-CinderUnicodeTest-729416530 None] Lock "cinder-a6307db1-5bb3-4c11-8bf7-2c039f20c5af-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Creating offline snapshot 52f3e279-82cf-4c18-98d1-53d86de359f6 of volume 320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9e35e2-51ef-41e1-8469-ef844a4f0ac0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:48 devstack sudo[104171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:09:48 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:48 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:48 devstack sudo[104176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 1G
Sep 04 06:09:48 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:49 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 1G" returned: 0 in 0.579s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b8b40-6355-4ff8-8aea-c348264b944d -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:49 devstack sudo[104183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b8b40-6355-4ff8-8aea-c348264b944d -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:09:49 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:49 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320b8b40-6355-4ff8-8aea-c348264b944d -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.422s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 is being set with open permissions: ugo+rw
Sep 04 06:09:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:49 devstack sudo[104190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:09:49 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:50 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.329s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:50 devstack sudo[104195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info
Sep 04 06:09:50 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:50 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info is being set with open permissions: ugo+rw
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:50 devstack sudo[104198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info
Sep 04 06:09:50 devstack sudo[104198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:50 devstack sudo[104198]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.info" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-88832e08-ea5c-4c19-b69c-80728d79b519 tempest-TestStampPattern-1733924651 None] Create snapshot completed successfully
Sep 04 06:09:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dd1669e8-cfb3-461c-b3ec-0bfc971bb54c req-147cc22b-6373-49ff-b186-8bcc046fca58 tempest-TestShelveInstance-24213871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dd1669e8-cfb3-461c-b3ec-0bfc971bb54c req-147cc22b-6373-49ff-b186-8bcc046fca58 tempest-TestShelveInstance-24213871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-dd1669e8-cfb3-461c-b3ec-0bfc971bb54c req-147cc22b-6373-49ff-b186-8bcc046fca58 tempest-TestShelveInstance-24213871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-dd1669e8-cfb3-461c-b3ec-0bfc971bb54c req-147cc22b-6373-49ff-b186-8bcc046fca58 tempest-TestShelveInstance-24213871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98189547-8313-4f73-86e9-3369a4d62f46', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:09:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-dd1669e8-cfb3-461c-b3ec-0bfc971bb54c req-147cc22b-6373-49ff-b186-8bcc046fca58 tempest-TestShelveInstance-24213871 None] attachment_update completed successfully.
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Flow 'volume_create_manager' (ecae3057-9ecd-4eba-a92b-292008fa6b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372292be-9caa-4ff6-b85b-64d334df09ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372292be-9caa-4ff6-b85b-64d334df09ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899724196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32d1499-249a-4d2b-a32c-9dcdc680ae77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65099f81f6447b4a21fe82cfade9fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:53Z,use_quota=True,user_id='b731ffe713f74d1c86d8c42a3524bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663e8fc6-1681-42d3-8361-f549e7ebbc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663e8fc6-1681-42d3-8361-f549e7ebbc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fc0aba-a114-4fd1-8c1b-9fb732ceae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3fc0aba-a114-4fd1-8c1b-9fb732ceae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f32d1499-249a-4d2b-a32c-9dcdc680ae77', 'volume_name': 'volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5413488-94f7-4457-8a29-0c817580d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5413488-94f7-4457-8a29-0c817580d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339fba02-31a3-466e-8da2-9966963a7d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Volume f32d1499-249a-4d2b-a32c-9dcdc680ae77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77', 'volume_size': 1}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1899724196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f32d1499-249a-4d2b-a32c-9dcdc680ae77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65099f81f6447b4a21fe82cfade9fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:53Z,use_quota=True,user_id='b731ffe713f74d1c86d8c42a3524bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Creating volume f32d1499-249a-4d2b-a32c-9dcdc680ae77 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:53 devstack sudo[104210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 1073741824
Sep 04 06:09:53 devstack sudo[104210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:53 devstack sudo[104210]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 1073741824" returned: 0 in 0.723s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:54 devstack sudo[104221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77
Sep 04 06:09:54 devstack sudo[104221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:54 devstack sudo[104221]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (339fba02-31a3-466e-8da2-9966963a7d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b7c953-c5c2-456c-a890-ffdd492e1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Volume volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 (f32d1499-249a-4d2b-a32c-9dcdc680ae77): created successfully
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7b7c953-c5c2-456c-a890-ffdd492e1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Flow 'volume_create_manager' (ecae3057-9ecd-4eba-a92b-292008fa6b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f46c5655-5d87-4ac9-82aa-eb3e7e807c63 tempest-ProjectReaderTests-230835145 None] Created volume successfully.
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Acquiring lock "cinder-f32d1499-249a-4d2b-a32c-9dcdc680ae77-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "cinder-f32d1499-249a-4d2b-a32c-9dcdc680ae77-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Acquiring lock "cinder-quobyte-f32d1499-249a-4d2b-a32c-9dcdc680ae77" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "cinder-quobyte-f32d1499-249a-4d2b-a32c-9dcdc680ae77" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ccdc20-1a1e-4952-8683-e18774d4a5b1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:09:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:55 devstack sudo[104315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77
Sep 04 06:09:55 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:56 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77" returned: 0 in 0.745s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:56 devstack sudo[104678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77
Sep 04 06:09:56 devstack sudo[104678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:56 devstack sudo[104678]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f32d1499-249a-4d2b-a32c-9dcdc680ae77" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "cinder-quobyte-f32d1499-249a-4d2b-a32c-9dcdc680ae77" released by "delete_volume" :: held 1.274s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Created reservations ['70ff1db3-a9a2-4baa-a738-a0b416cab8c9', '6c7dc1d8-bb96-4555-b9db-ecf346ab18c7', '5976722e-31dd-49b9-9f6d-66744efb727a', '672e8e8a-104a-49a2-b14f-74c3e58542c5'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:57 devstack sudo[104699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:09:57 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:57 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:09:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Deleted volume successfully.
Sep 04 06:09:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-14468a45-86c5-400e-8f9f-0ceccaf267ad tempest-ProjectReaderTests-230835145 None] Lock "cinder-f32d1499-249a-4d2b-a32c-9dcdc680ae77-delete_volume" released by "delete_volume" :: held 2.025s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Flow 'volume_create_manager' (fa7ef325-72a4-4b8d-b98a-68e6f190ff23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324dbefe-6d3c-47f9-aea2-610dacb8fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324dbefe-6d3c-47f9-aea2-610dacb8fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530973587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d1e5c2-c0e4-4e47-95ec-e24e5d935825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65099f81f6447b4a21fe82cfade9fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:59Z,use_quota=True,user_id='b731ffe713f74d1c86d8c42a3524bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500ec81c-4cb3-4e27-854d-cf257884e35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500ec81c-4cb3-4e27-854d-cf257884e35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee210f8-c9f3-43ae-b612-46d7f80e066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee210f8-c9f3-43ae-b612-46d7f80e066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00d1e5c2-c0e4-4e47-95ec-e24e5d935825', 'volume_name': 'volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046898b4-6aee-4c7e-9480-6dc44fbb9ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046898b4-6aee-4c7e-9480-6dc44fbb9ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a47dba3-99c2-4cb9-8dac-456b43696813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:09:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Volume 00d1e5c2-c0e4-4e47-95ec-e24e5d935825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825', 'volume_size': 1}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530973587',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00d1e5c2-c0e4-4e47-95ec-e24e5d935825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65099f81f6447b4a21fe82cfade9fa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:09:59Z,use_quota=True,user_id='b731ffe713f74d1c86d8c42a3524bba8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Creating volume 00d1e5c2-c0e4-4e47-95ec-e24e5d935825 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:09:58 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:09:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:58 devstack sudo[104704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 1073741824
Sep 04 06:09:58 devstack sudo[104704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:09:59 devstack sudo[104704]: pam_unix(sudo:session): session closed for user root
Sep 04 06:09:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 1073741824" returned: 0 in 0.738s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:09:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:09:59 devstack sudo[104710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825
Sep 04 06:09:59 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:00 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a47dba3-99c2-4cb9-8dac-456b43696813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7426fd2f-ccf2-4845-be84-f82738e4f80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Volume volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 (00d1e5c2-c0e4-4e47-95ec-e24e5d935825): created successfully
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7426fd2f-ccf2-4845-be84-f82738e4f80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Flow 'volume_create_manager' (fa7ef325-72a4-4b8d-b98a-68e6f190ff23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2eae849a-cf9e-4862-ac4e-147044470365 tempest-ProjectReaderTests-230835145 None] Created volume successfully.
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Acquiring lock "cinder-00d1e5c2-c0e4-4e47-95ec-e24e5d935825-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "cinder-00d1e5c2-c0e4-4e47-95ec-e24e5d935825-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Acquiring lock "cinder-quobyte-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "cinder-quobyte-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8aad9a-d7bb-45f0-a174-d5f59aa2e7bc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:01 devstack sudo[104714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825
Sep 04 06:10:01 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Flow 'volume_create_manager' (f39e0f7f-f3ea-4847-9380-f77b04c124b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616ff717-6373-4da3-ae1d-8cc719804500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (616ff717-6373-4da3-ae1d-8cc719804500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-995104518',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9050ac35-16c1-4e24-a9dc-41bcb1d0caf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c33136334ec4265881899c341bf9995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52f3e279-82cf-4c18-98d1-53d86de359f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:02Z,use_quota=True,user_id='f0d680183d8a4b9bbc222dc0f645500c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8058ad78-08fd-42a1-ad32-073281a5a9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8058ad78-08fd-42a1-ad32-073281a5a9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1864105b-575f-434d-ad29-5959045913fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1864105b-575f-434d-ad29-5959045913fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9050ac35-16c1-4e24-a9dc-41bcb1d0caf7', 'volume_name': 'volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7', 'volume_size': 1, 'snapshot_id': '52f3e279-82cf-4c18-98d1-53d86de359f6'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:01 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6738a3-7189-4c05-ae70-0ee05912c53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6738a3-7189-4c05-ae70-0ee05912c53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194f214a-b8c7-4d60-bd3f-86047cefc43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:02 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Volume 9050ac35-16c1-4e24-a9dc-41bcb1d0caf7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7', 'volume_size': 1, 'snapshot_id': '52f3e279-82cf-4c18-98d1-53d86de359f6'}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" returned: 0 in 0.797s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Creating volume 9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 from snapshot 52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:10:02 devstack sudo[104719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825
Sep 04 06:10:02 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] snapshot: 52f3e279-82cf-4c18-98d1-53d86de359f6, volume: 9050ac35-16c1-4e24-a9dc-41bcb1d0caf7,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2964083b-427a-426f-b5c6-a82e560fff9d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:02 devstack sudo[104721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:10:02 devstack sudo[104721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:02 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" returned: 0 in 0.661s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "cinder-quobyte-00d1e5c2-c0e4-4e47-95ec-e24e5d935825" released by "delete_volume" :: held 1.559s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Created reservations ['419546b0-cdb9-480a-acd4-487fb87a9c28', '9e0a7610-4f47-49f0-b420-e499c2743acd', '58d12eba-204f-4179-99b8-c3bf0a6b85be', '156edae2-d3c5-478a-9c00-3ae0233652f1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:03 devstack sudo[104725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:10:03 devstack sudo[104725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:03 devstack sudo[104721]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.898s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b8b40-6355-4ff8-8aea-c348264b944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cca908-f1b6-4466-abe6-9739754a1c8b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:03 devstack sudo[104729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:10:03 devstack sudo[104729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:03 devstack sudo[104725]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.779s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:10:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Deleted volume successfully.
Sep 04 06:10:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-efa81b54-06be-4d4c-98bd-f9f0d3faf537 tempest-ProjectReaderTests-230835145 None] Lock "cinder-00d1e5c2-c0e4-4e47-95ec-e24e5d935825-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:04 devstack sudo[104729]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.834s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:10:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:10:04 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:10:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:04 devstack sudo[104739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7
Sep 04 06:10:04 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:11 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" returned: 0 in 7.679s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:11 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:10:11 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Converted 1024.00 MB image at 133.33 MB/s
Sep 04 06:10:11 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 is being set with open permissions: ugo+rw
Sep 04 06:10:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:11 devstack sudo[104758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7
Sep 04 06:10:11 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:12 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" returned: 0 in 0.565s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" released by "_copy_volume_from_snapshot" :: held 10.212s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=85,cinder:UPDATE=76,cinder:INSERT=22,cinder:DELETE=11 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" released by "_create_volume_from_snapshot" :: held 10.435s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.477s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194f214a-b8c7-4d60-bd3f-86047cefc43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7', 'volume_size': 1, 'snapshot_id': '52f3e279-82cf-4c18-98d1-53d86de359f6'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b5e4b-759c-41c8-93fd-10bd2577542e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:12 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Volume volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 (9050ac35-16c1-4e24-a9dc-41bcb1d0caf7): created successfully
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b5e4b-759c-41c8-93fd-10bd2577542e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Flow 'volume_create_manager' (f39e0f7f-f3ea-4847-9380-f77b04c124b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:12 devstack sudo[104761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:10:12 devstack sudo[104761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-02772aff-9b25-4072-82ad-c2515eacef41 tempest-TestStampPattern-1733924651 None] Created volume successfully.
Sep 04 06:10:13 devstack sudo[104761]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.586s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:10:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:10:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:10:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:10:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:10:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=77,cinder:UPDATE=77,cinder:INSERT=34,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:10:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-65195693-462a-4659-9c93-6218fa8b6015 req-6f57bf34-c47d-42e9-97a9-428a2579c200 tempest-TestShelveInstance-24213871 None] Terminate volume connection completed successfully.
Sep 04 06:10:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-65195693-462a-4659-9c93-6218fa8b6015 req-6f57bf34-c47d-42e9-97a9-428a2579c200 tempest-TestShelveInstance-24213871 None] Deleting attachment 98189547-8313-4f73-86e9-3369a4d62f46. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:10:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aba137dc-cd2e-485d-bcff-6f47a50913e0 req-d1eb8ad4-ece9-4701-8f93-07e438cef672 tempest-TestShelveInstance-24213871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aba137dc-cd2e-485d-bcff-6f47a50913e0 req-d1eb8ad4-ece9-4701-8f93-07e438cef672 tempest-TestShelveInstance-24213871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-aba137dc-cd2e-485d-bcff-6f47a50913e0 req-d1eb8ad4-ece9-4701-8f93-07e438cef672 tempest-TestShelveInstance-24213871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-aba137dc-cd2e-485d-bcff-6f47a50913e0 req-d1eb8ad4-ece9-4701-8f93-07e438cef672 tempest-TestShelveInstance-24213871 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cd43a7e-0dd0-46cd-8bf2-0f2cb366c9df', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:10:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-aba137dc-cd2e-485d-bcff-6f47a50913e0 req-d1eb8ad4-ece9-4701-8f93-07e438cef672 tempest-TestShelveInstance-24213871 None] attachment_update completed successfully.
Sep 04 06:10:45 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:10:45 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Flow 'volume_create_manager' (1f0b8135-2ffc-455d-8192-bc8a04088562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ed1793-9bf0-47fb-aba0-f04abd7c5a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8ed1793-9bf0-47fb-aba0-f04abd7c5a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1637572890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd7297c-d45f-4d2b-b141-994e10df6713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1655cb20bc407ebca6e4c3c1f9fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:47Z,use_quota=True,user_id='01ae904f3d7048e3be66deac25905e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24509bdb-768c-4f9f-a933-06ccb8acb3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24509bdb-768c-4f9f-a933-06ccb8acb3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fabf96b-f140-475c-87b9-c64123739ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fabf96b-f140-475c-87b9-c64123739ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd7297c-d45f-4d2b-b141-994e10df6713', 'volume_name': 'volume-2fd7297c-d45f-4d2b-b141-994e10df6713', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404fdc7b-fc18-4217-abcd-ac66facd32fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (404fdc7b-fc18-4217-abcd-ac66facd32fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df70cea7-97e9-4e2d-9569-bbc6d0325807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Volume 2fd7297c-d45f-4d2b-b141-994e10df6713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd7297c-d45f-4d2b-b141-994e10df6713', 'volume_size': 1}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1637572890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd7297c-d45f-4d2b-b141-994e10df6713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1655cb20bc407ebca6e4c3c1f9fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:47Z,use_quota=True,user_id='01ae904f3d7048e3be66deac25905e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Creating volume 2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:10:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:47 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 1073741824
Sep 04 06:10:47 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:47 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 1073741824" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:47 devstack sudo[105445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:10:47 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:48 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df70cea7-97e9-4e2d-9569-bbc6d0325807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd7297c-d45f-4d2b-b141-994e10df6713', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89e600-1636-44b7-af19-bc6f0087d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Volume volume-2fd7297c-d45f-4d2b-b141-994e10df6713 (2fd7297c-d45f-4d2b-b141-994e10df6713): created successfully
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc89e600-1636-44b7-af19-bc6f0087d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Flow 'volume_create_manager' (1f0b8135-2ffc-455d-8192-bc8a04088562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8465f4a2-59fd-4137-9474-0df76f5188ba tempest-SnapshotDependencyTests-8509516 None] Created volume successfully.
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Creating offline snapshot d1848c4b-2118-412f-bffa-60034a201f7e of volume 2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f0421f-c15e-44b4-91b8-230105f95596]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:48 devstack sudo[105448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:10:48 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:49 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:49 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e 1G
Sep 04 06:10:49 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:49 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e 1G" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd7297c-d45f-4d2b-b141-994e10df6713 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:49 devstack sudo[105458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd7297c-d45f-4d2b-b141-994e10df6713 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:10:49 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:49 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd7297c-d45f-4d2b-b141-994e10df6713 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:49 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e is being set with open permissions: ugo+rw
Sep 04 06:10:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:49 devstack sudo[105463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:10:49 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:50 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.236s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:50 devstack sudo[105466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info
Sep 04 06:10:50 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:50 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info is being set with open permissions: ugo+rw
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:50 devstack sudo[105469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info
Sep 04 06:10:50 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:50 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.info" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-19c146a2-aa89-473a-9417-b05b2e9082b6 tempest-SnapshotDependencyTests-8509516 None] Create snapshot completed successfully
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Flow 'volume_create_manager' (326a39c0-9aa5-4a43-9911-fc35edcf6203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459a24a7-ac5d-4cf4-abee-b7597b310987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459a24a7-ac5d-4cf4-abee-b7597b310987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5e969b-a359-412a-98cc-9fc93d36ae98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1655cb20bc407ebca6e4c3c1f9fe8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:10:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1848c4b-2118-412f-bffa-60034a201f7e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:10:52Z,use_quota=True,user_id='01ae904f3d7048e3be66deac25905e23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156a9169-3453-42f7-a83d-680d814022e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (156a9169-3453-42f7-a83d-680d814022e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13732d1d-3328-4b2b-bc78-81814239879b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13732d1d-3328-4b2b-bc78-81814239879b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ce5e969b-a359-412a-98cc-9fc93d36ae98', 'volume_name': 'volume-ce5e969b-a359-412a-98cc-9fc93d36ae98', 'volume_size': 1, 'snapshot_id': 'd1848c4b-2118-412f-bffa-60034a201f7e'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c8acd4-ff0d-4bba-9fc6-ec99a4932888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32c8acd4-ff0d-4bba-9fc6-ec99a4932888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433f0b02-a521-4e63-b81d-030013b594bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Volume ce5e969b-a359-412a-98cc-9fc93d36ae98: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ce5e969b-a359-412a-98cc-9fc93d36ae98', 'volume_size': 1, 'snapshot_id': 'd1848c4b-2118-412f-bffa-60034a201f7e'}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e-ce5e969b-a359-412a-98cc-9fc93d36ae98" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e-ce5e969b-a359-412a-98cc-9fc93d36ae98" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Creating volume ce5e969b-a359-412a-98cc-9fc93d36ae98 from snapshot d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] snapshot: d1848c4b-2118-412f-bffa-60034a201f7e, volume: ce5e969b-a359-412a-98cc-9fc93d36ae98,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5946f454-f4a5-467a-98f0-984ce7343381]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:52 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:10:52 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:52 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.357s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd7297c-d45f-4d2b-b141-994e10df6713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad233781-2fad-4f64-bc97-27e0652b62e7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:53 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:10:53 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:53 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:10:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:53 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98
Sep 04 06:10:53 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:58 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98" returned: 0 in 5.110s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:10:58 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Converted 1024.00 MB image at 200.32 MB/s
Sep 04 06:10:58 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 is being set with open permissions: ugo+rw
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:58 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98
Sep 04 06:10:58 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:58 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" released by "_copy_volume_from_snapshot" :: held 6.211s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e-ce5e969b-a359-412a-98cc-9fc93d36ae98" released by "_create_volume_from_snapshot" :: held 6.298s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.313s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433f0b02-a521-4e63-b81d-030013b594bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5e969b-a359-412a-98cc-9fc93d36ae98', 'volume_size': 1, 'snapshot_id': 'd1848c4b-2118-412f-bffa-60034a201f7e'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340cc7c5-e0c3-4e7b-b863-bf9d469b908f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:10:58 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Volume volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 (ce5e969b-a359-412a-98cc-9fc93d36ae98): created successfully
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340cc7c5-e0c3-4e7b-b863-bf9d469b908f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:10:58 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Flow 'volume_create_manager' (326a39c0-9aa5-4a43-9911-fc35edcf6203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:10:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e985f4f1-612c-400f-9a14-a0c8c3572977 tempest-SnapshotDependencyTests-8509516 None] Created volume successfully.
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-07770e31-f52b-4a92-9f1b-cf8daa25bc70 req-003a6864-79bc-4670-8db3-4c5212dd7914 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-07770e31-f52b-4a92-9f1b-cf8daa25bc70 req-003a6864-79bc-4670-8db3-4c5212dd7914 tempest-TestStampPattern-1733924651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-07770e31-f52b-4a92-9f1b-cf8daa25bc70 req-003a6864-79bc-4670-8db3-4c5212dd7914 tempest-TestStampPattern-1733924651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-07770e31-f52b-4a92-9f1b-cf8daa25bc70 req-003a6864-79bc-4670-8db3-4c5212dd7914 tempest-TestStampPattern-1733924651 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32', 'name': 'volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8dd0ad5-dbc7-4887-8851-0333c27f521b', 'enforce_multipath': True} {{(pid=87095) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Sep 04 06:10:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-07770e31-f52b-4a92-9f1b-cf8daa25bc70 req-003a6864-79bc-4670-8db3-4c5212dd7914 tempest-TestStampPattern-1733924651 None] attachment_update completed successfully.
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-d1848c4b-2118-412f-bffa-60034a201f7e-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-d1848c4b-2118-412f-bffa-60034a201f7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Deleting offline snapshot d1848c4b-2118-412f-bffa-60034a201f7e of volume 2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] snapshot_file for this snap is: volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cade10-4843-40cc-bca3-3816da1407d9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:10:59 devstack sudo[105553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:10:59 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:10:59 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd7297c-d45f-4d2b-b141-994e10df6713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0846277-8067-4913-82e1-0a8fd157934a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:10:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:00 devstack sudo[105558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:11:00 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:00 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.612s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:00 devstack sudo[105575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:11:00 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:00 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:00 devstack sudo[105585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e
Sep 04 06:11:00 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:01 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713.d1848c4b-2118-412f-bffa-60034a201f7e" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-d1848c4b-2118-412f-bffa-60034a201f7e" released by "_delete_snapshot" :: held 1.884s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" released by "delete_snapshot" :: held 1.914s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Created reservations ['91eb669c-f3d5-43df-a8f9-ffb5c907c8b9', 'f6d1914d-b761-4c9e-88e8-1b5c8e9bb2b6', '4c007f66-b433-4ade-9698-9a877e8e3298', '395c6660-d5a4-4a92-b92f-1d73185238d4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Delete snapshot completed successfully.
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-75b66cd3-bd53-4239-a3f3-d8e3b5c38ba1 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-d1848c4b-2118-412f-bffa-60034a201f7e-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-2fd7297c-d45f-4d2b-b141-994e10df6713-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-2fd7297c-d45f-4d2b-b141-994e10df6713-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-438be589-889d-4e92-a0f9-94d149130932 req-30137e5f-bb52-413e-a9dd-85f4975efb5c tempest-TestStampPattern-1733924651 None] Terminate volume connection completed successfully.
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-438be589-889d-4e92-a0f9-94d149130932 req-30137e5f-bb52-413e-a9dd-85f4975efb5c tempest-TestStampPattern-1733924651 None] Deleting attachment d8dd0ad5-dbc7-4887-8851-0333c27f521b. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6736d712-70f3-49ee-b461-d94c5dd508cf]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:01 devstack sudo[105591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:11:01 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:02 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:02 devstack sudo[105596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713
Sep 04 06:11:02 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:02 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fd7297c-d45f-4d2b-b141-994e10df6713" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-2fd7297c-d45f-4d2b-b141-994e10df6713" released by "delete_volume" :: held 0.793s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Created reservations ['8fd3b743-e024-4c3e-bd2a-900876d0ff8d', 'b412cc13-ba57-40b0-9e77-d4de16028fdb', '05ae574e-0beb-44f9-9c53-bb48492956e7', 'ffb9a308-1345-4afb-8846-19d81c50101f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:02 devstack sudo[105599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:02 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-ce5e969b-a359-412a-98cc-9fc93d36ae98-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-ce5e969b-a359-412a-98cc-9fc93d36ae98-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" acquired by "delete_volume" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:02 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:02 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Deleted volume successfully.
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6178607-4ab3-4a0e-b275-6a94b79ed6c1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c9641a83-3305-4990-82e4-c6b25a47dff9 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-2fd7297c-d45f-4d2b-b141-994e10df6713-delete_volume" released by "delete_volume" :: held 1.387s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:03 devstack sudo[105602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98
Sep 04 06:11:03 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:03 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98" returned: 0 in 0.543s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:03 devstack sudo[105610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98
Sep 04 06:11:03 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:03 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ce5e969b-a359-412a-98cc-9fc93d36ae98" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-quobyte-ce5e969b-a359-412a-98cc-9fc93d36ae98" released by "delete_volume" :: held 0.979s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Created reservations ['7be556c2-863c-4226-bff7-47de455be21b', 'f5831ab4-8369-410f-9b6e-48af4f1f138b', 'eb42243f-4259-46a2-a9ee-9449ce975c84', 'e1df95da-65d0-422f-bf14-7dd363f70986'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:04 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:04 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:04 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Deleted volume successfully.
Sep 04 06:11:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2b27f637-65d2-4945-9479-8c76808f6674 tempest-SnapshotDependencyTests-8509516 None] Lock "cinder-ce5e969b-a359-412a-98cc-9fc93d36ae98-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "cinder-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[0246c96a-0d7c-4057-93d9-015f387e9c93]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:07 devstack sudo[105643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7
Sep 04 06:11:07 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:07 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:07 devstack sudo[105648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7
Sep 04 06:11:07 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:08 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7" released by "delete_volume" :: held 0.735s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Created reservations ['20e99576-6418-486b-9fa9-78c26cd8d9e1', '9fdf6a2b-227e-42ec-aefb-ec22b5d7fa5b', '58d9f413-ba82-457a-a3f0-33b534f3ef22', '88958c5d-3d77-45d3-befb-9253d6e7a5aa'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:08 devstack sudo[105651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:08 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:08 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Deleted volume successfully.
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0ad5fd2a-d9f6-45bc-a5ea-6074e25e6029 tempest-TestStampPattern-1733924651 None] Lock "cinder-9050ac35-16c1-4e24-a9dc-41bcb1d0caf7-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-52f3e279-82cf-4c18-98d1-53d86de359f6-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-52f3e279-82cf-4c18-98d1-53d86de359f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Deleting offline snapshot 52f3e279-82cf-4c18-98d1-53d86de359f6 of volume 320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] snapshot_file for this snap is: volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c33cd3-f3f7-4096-b1ee-e991e47a4509]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:08 devstack sudo[105654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:11:08 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:09 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320b8b40-6355-4ff8-8aea-c348264b944d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92edd25-0a9d-4d5b-a74f-9901b8b5a469]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:09 devstack sudo[105659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:11:09 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:09 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.612s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:09 devstack sudo[105666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:11:09 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:10 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:10 devstack sudo[105672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6
Sep 04 06:11:10 devstack sudo[105672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:10 devstack sudo[105672]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d.52f3e279-82cf-4c18-98d1-53d86de359f6" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-52f3e279-82cf-4c18-98d1-53d86de359f6" released by "_delete_snapshot" :: held 1.877s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" released by "delete_snapshot" :: held 1.906s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Created reservations ['f53679ff-e237-4306-81c5-f6506da5e59b', 'fcbf6c1a-c383-445a-b50b-af044bb05c45', 'fe4d6161-458d-49cd-a4b2-b1cd3e027049', '231852f1-1c28-4dba-8853-1a063bab798c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Delete snapshot completed successfully.
Sep 04 06:11:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c7d22d97-1fe8-4d8c-b5a5-220e5208ddae tempest-TestStampPattern-1733924651 None] Lock "cinder-52f3e279-82cf-4c18-98d1-53d86de359f6-delete_snapshot" released by "delete_snapshot" :: held 2.054s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:12 devstack sudo[105698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:12 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:12 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:11:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-320b8b40-6355-4ff8-8aea-c348264b944d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "cinder-320b8b40-6355-4ff8-8aea-c348264b944d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Acquiring lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ed9790-2b0c-4ff8-8160-0c0a5fbaec3e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:15 devstack sudo[105708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:11:15 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:15 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:15 devstack sudo[105714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d
Sep 04 06:11:15 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:16 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-320b8b40-6355-4ff8-8aea-c348264b944d" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "cinder-quobyte-320b8b40-6355-4ff8-8aea-c348264b944d" released by "delete_volume" :: held 0.804s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Created reservations ['457cb063-9756-45ff-8ec0-87c3dc1d8bbd', 'cacf1ea2-4cf2-466d-8190-b0e92d62607d', 'b81f66dd-9e13-44d4-a189-fc449acdb874', '255a1884-36cb-4676-9d7c-8ae34298a766'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:16 devstack sudo[105717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:16 devstack sudo[105717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:16 devstack sudo[105717]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Deleted volume successfully.
Sep 04 06:11:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eb010c9e-fb36-4a5d-9da4-130aba87a2d6 tempest-TestStampPattern-1733924651 None] Lock "cinder-320b8b40-6355-4ff8-8aea-c348264b944d-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-2a14c872-1031-43ce-8e80-540de3bd826e tempest-TestShelveInstance-24213871 None] Terminate volume connection completed successfully.
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-2a14c872-1031-43ce-8e80-540de3bd826e tempest-TestShelveInstance-24213871 None] Deleting attachment 0cd43a7e-0dd0-46cd-8bf2-0f2cb366c9df. {{(pid=87095) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Acquiring lock "cinder-d5ae6524-1056-4ed5-8544-9e72c192cfe1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "cinder-d5ae6524-1056-4ed5-8544-9e72c192cfe1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Acquiring lock "cinder-quobyte-d5ae6524-1056-4ed5-8544-9e72c192cfe1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "cinder-quobyte-d5ae6524-1056-4ed5-8544-9e72c192cfe1" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c690f8-7d20-450d-8eb6-02c99e202d81]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:20 devstack sudo[105750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1
Sep 04 06:11:20 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:21 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1" returned: 0 in 0.484s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:21 devstack sudo[105756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1
Sep 04 06:11:21 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:21 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d5ae6524-1056-4ed5-8544-9e72c192cfe1" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "cinder-quobyte-d5ae6524-1056-4ed5-8544-9e72c192cfe1" released by "delete_volume" :: held 0.850s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG cinder.quota [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Created reservations ['be79dae5-7dbf-43e8-9b69-149425d3b3a4', '53263815-de5b-454c-9851-476a5aea4679', 'da1dbb1d-ba55-486a-b7e0-2dba8a0e1d5c', '8750ddf9-562a-496f-9d24-9e29538da75e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:21 devstack sudo[105761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:21 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:22 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:22 devstack cinder-volume[87095]: DEBUG cinder.manager [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Deleted volume successfully.
Sep 04 06:11:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [req-27cafdec-ff77-43d9-a5bb-f7cc87f36883 req-9d3a4304-f30e-4452-a4b8-2b1fce77f230 tempest-TestShelveInstance-24213871 None] Lock "cinder-d5ae6524-1056-4ed5-8544-9e72c192cfe1-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:31 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=51,cinder:UPDATE=65,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:11:32 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=57,cinder:UPDATE=56,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Flow 'volume_create_manager' (9c7fae59-b23f-4be3-a093-a7853ae6c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5fd833-5b91-4729-b5db-ac66c0617c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5fd833-5b91-4729-b5db-ac66c0617c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452cd605-9b56-4ad0-ba85-73702d3407ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52cb9a059b464a8d5b212f1fe9c96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:36Z,use_quota=True,user_id='7931d93bacc0477fb9d629a7b7e3b68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af91a3ce-381e-41a4-96d2-846d291aeef1),volume_type_id=af91a3ce-381e-41a4-96d2-846d291aeef1)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beefba2e-b710-4e15-8fca-c0474ffaa6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beefba2e-b710-4e15-8fca-c0474ffaa6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee816a0-40bf-4d41-835d-9e2d7f137073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee816a0-40bf-4d41-835d-9e2d7f137073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '452cd605-9b56-4ad0-ba85-73702d3407ce', 'volume_name': 'volume-452cd605-9b56-4ad0-ba85-73702d3407ce', 'volume_size': 1, 'image_id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d6116a5fcd4e028997d8e3e19a845a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed52cb9a059b464a8d5b212f1fe9c96a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e368389218b860d27fa70a37ea5f029f35c1ce7ec5251afffbfd627ede3db509c0b97625d8b0d21ca7cfa05936358e479f9c7434d709d018a947119df735cc6b', 'id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'created_at': datetime.datetime(2026, 9, 4, 4, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e74deb0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7fb122-c21d-4550-9324-8a8aa4623cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a7fb122-c21d-4550-9324-8a8aa4623cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ebb333-6258-4cd5-88e8-0594211fe679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:36 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Volume 452cd605-9b56-4ad0-ba85-73702d3407ce: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-452cd605-9b56-4ad0-ba85-73702d3407ce', 'volume_size': 1, 'image_id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d6116a5fcd4e028997d8e3e19a845a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed52cb9a059b464a8d5b212f1fe9c96a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e368389218b860d27fa70a37ea5f029f35c1ce7ec5251afffbfd627ede3db509c0b97625d8b0d21ca7cfa05936358e479f9c7434d709d018a947119df735cc6b', 'id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'created_at': datetime.datetime(2026, 9, 4, 4, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e74deb0>}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Trying to clone 452cd605-9b56-4ad0-ba85-73702d3407ce from image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:11:36 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:36 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (8a29e3e0-5930-474f-839e-6d2c2a4d0147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0bbd5a-9451-4705-bfcd-73cd42f83d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1295ff5a-66d0-4491-a618-2db2a5f793ce]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0bbd5a-9451-4705-bfcd-73cd42f83d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495549683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84231c9-b5cd-4e69-a17b-6ec775264224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:37Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b354d20-acac-49b2-be79-7ac7c3f2c900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b354d20-acac-49b2-be79-7ac7c3f2c900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b7f36-c45a-4d7d-ac0e-bb5fed33b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4b7f36-c45a-4d7d-ac0e-bb5fed33b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd84231c9-b5cd-4e69-a17b-6ec775264224', 'volume_name': 'volume-d84231c9-b5cd-4e69-a17b-6ec775264224', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1473c1ba-2573-432e-a210-7667309a918a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1473c1ba-2573-432e-a210-7667309a918a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa213060-ba82-43aa-97f9-a0267ea060b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume d84231c9-b5cd-4e69-a17b-6ec775264224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d84231c9-b5cd-4e69-a17b-6ec775264224', 'volume_size': 1}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495549683',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84231c9-b5cd-4e69-a17b-6ec775264224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:37Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:37 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:37 devstack sudo[105774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 1073741824
Sep 04 06:11:37 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:37 devstack sudo[105773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:37 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:37 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:37 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 1073741824" returned: 0 in 0.502s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:37 devstack sudo[105820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224
Sep 04 06:11:37 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:37 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:37 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:37 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:37 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 1 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Temporary image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 is fetched for user 7931d93bacc0477fb9d629a7b7e3b68a. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa213060-ba82-43aa-97f9-a0267ea060b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84231c9-b5cd-4e69-a17b-6ec775264224', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14f3fe7-e465-4c8a-8c45-ca2fef74ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:37 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-d84231c9-b5cd-4e69-a17b-6ec775264224 (d84231c9-b5cd-4e69-a17b-6ec775264224): created successfully
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14f3fe7-e465-4c8a-8c45-ca2fef74ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:37 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (8a29e3e0-5930-474f-839e-6d2c2a4d0147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-952e4b6c-2565-467f-bf16-a45b53a208c9 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[533a3c6c-090a-4757-b2a4-68545f41eba6]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:38 devstack sudo[105827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:38 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:38 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:38 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:38 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:38 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452cd605-9b56-4ad0-ba85-73702d3407ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed52cb9a059b464a8d5b212f1fe9c96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:36Z,use_quota=True,user_id='7931d93bacc0477fb9d629a7b7e3b68a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af91a3ce-381e-41a4-96d2-846d291aeef1),volume_type_id=af91a3ce-381e-41a4-96d2-846d291aeef1)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Creating volume 452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:38 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:38 devstack sudo[105836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1073741824
Sep 04 06:11:38 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:39 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1073741824" returned: 0 in 0.462s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:39 devstack sudo[105842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce
Sep 04 06:11:39 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:39 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce" returned: 0 in 0.304s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.227s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating offline snapshot 49569add-a199-4656-9c75-bee7ef7b0c55 of volume d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Attempting download of 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}])) to volume 452cd605-9b56-4ad0-ba85-73702d3407ce. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cf4b16-acc5-464d-a038-8168502f8c1d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57007de-44eb-452e-8527-25e3ec7465fb]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:39 devstack sudo[105845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224
Sep 04 06:11:39 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:39 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj
Sep 04 06:11:39 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack sudo[105855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 1G
Sep 04 06:11:40 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj
Sep 04 06:11:40 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj" returned: 1 in 0.362s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_68oh7jlj' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2be998-f112-4f50-8d39-cdad20e2fa03]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 1G" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84231c9-b5cd-4e69-a17b-6ec775264224 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack sudo[105864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:40 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84231c9-b5cd-4e69-a17b-6ec775264224 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55
Sep 04 06:11:40 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d84231c9-b5cd-4e69-a17b-6ec775264224 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:40 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 is being set with open permissions: ugo+rw
Sep 04 06:11:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:40 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55
Sep 04 06:11:40 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:40 devstack sudo[105873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD
Sep 04 06:11:40 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:41 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:41 devstack sudo[105883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce
Sep 04 06:11:41 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:41 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info
Sep 04 06:11:41 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:41 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info is being set with open permissions: ugo+rw
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:41 devstack sudo[105891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info
Sep 04 06:11:41 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:41 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce" returned: 0 in 0.528s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2_4danjen1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:11:41 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:41 devstack sudo[105893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1G
Sep 04 06:11:41 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:41 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.info" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e0f8cb81-7397-49e9-8277-48e2f850e411 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Create snapshot completed successfully
Sep 04 06:11:41 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce 1G" returned: 0 in 0.336s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Downloaded image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 ((None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}])) to volume 452cd605-9b56-4ad0-ba85-73702d3407ce successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Temporary image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 for user 7931d93bacc0477fb9d629a7b7e3b68a is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Marking volume 452cd605-9b56-4ad0-ba85-73702d3407ce as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Copying metadata from image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 to 452cd605-9b56-4ad0-ba85-73702d3407ce. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:11:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Creating volume glance metadata for volume 452cd605-9b56-4ad0-ba85-73702d3407ce backed by image 2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '94d6116a5fcd4e028997d8e3e19a845a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07ebb333-6258-4cd5-88e8-0594211fe679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452cd605-9b56-4ad0-ba85-73702d3407ce', 'volume_size': 1, 'image_id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '94d6116a5fcd4e028997d8e3e19a845a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed52cb9a059b464a8d5b212f1fe9c96a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e368389218b860d27fa70a37ea5f029f35c1ce7ec5251afffbfd627ede3db509c0b97625d8b0d21ca7cfa05936358e479f9c7434d709d018a947119df735cc6b', 'id': '2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2', 'created_at': datetime.datetime(2026, 9, 4, 4, 11, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 11, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2d8ff2af-2b74-4a7e-9f8b-35c3db1e9be2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e74deb0>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fa8288-8df9-453c-971b-a32d4b8e18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Volume volume-452cd605-9b56-4ad0-ba85-73702d3407ce (452cd605-9b56-4ad0-ba85-73702d3407ce): created successfully
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24fa8288-8df9-453c-971b-a32d4b8e18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Flow 'volume_create_manager' (9c7fae59-b23f-4be3-a093-a7853ae6c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-566dc225-c62e-4543-83b2-cc3b24c46c64 tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Created volume successfully.
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Acquiring lock "cinder-452cd605-9b56-4ad0-ba85-73702d3407ce-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "cinder-452cd605-9b56-4ad0-ba85-73702d3407ce-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Acquiring lock "cinder-quobyte-452cd605-9b56-4ad0-ba85-73702d3407ce" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "cinder-quobyte-452cd605-9b56-4ad0-ba85-73702d3407ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e57d8-1487-4e42-9600-8c84eac52aee]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:42 devstack sudo[105900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce
Sep 04 06:11:42 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (e3273b1a-b45c-4b64-8dd9-ff83fd49ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30d3872-53ff-43c7-b8b8-ad3757821b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f30d3872-53ff-43c7-b8b8-ad3757821b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366958884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168fa785-c107-45b5-8f8b-8403d953d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:43Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0ae6ca-3d72-4528-a251-8510125794b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f0ae6ca-3d72-4528-a251-8510125794b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbb8cff-345b-48d4-8e8b-a1ade9f45038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cbb8cff-345b-48d4-8e8b-a1ade9f45038) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '168fa785-c107-45b5-8f8b-8403d953d13a', 'volume_name': 'volume-168fa785-c107-45b5-8f8b-8403d953d13a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234afacc-c5ba-46f0-b286-21298114b570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (234afacc-c5ba-46f0-b286-21298114b570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f199d25a-382a-4107-85e9-fc3659c6d0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume 168fa785-c107-45b5-8f8b-8403d953d13a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-168fa785-c107-45b5-8f8b-8403d953d13a', 'volume_size': 1}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-366958884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=168fa785-c107-45b5-8f8b-8403d953d13a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:43Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume 168fa785-c107-45b5-8f8b-8403d953d13a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:43 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:43 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a 1073741824
Sep 04 06:11:43 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:43 devstack sudo[105906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce
Sep 04 06:11:43 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:43 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-452cd605-9b56-4ad0-ba85-73702d3407ce" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "cinder-quobyte-452cd605-9b56-4ad0-ba85-73702d3407ce" released by "delete_volume" :: held 0.794s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (d7b4c14b-20a1-4902-af59-95b539f9238d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44af47c-d8e1-4d22-a25a-045515e19ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: WARNING cinder.quota [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:11:43 devstack cinder-volume[87095]: WARNING cinder.quota [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44af47c-d8e1-4d22-a25a-045515e19ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1874028763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde2fcc4-e451-435d-86ad-43fd2a61478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:44Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f57705-231e-41bb-b6cd-9454265ece5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f57705-231e-41bb-b6cd-9454265ece5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8404095-13fc-454f-a43d-55d848501c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8404095-13fc-454f-a43d-55d848501c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde2fcc4-e451-435d-86ad-43fd2a61478e', 'volume_name': 'volume-bde2fcc4-e451-435d-86ad-43fd2a61478e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6973c9-98bc-4f03-8cf7-68e34732c701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db6973c9-98bc-4f03-8cf7-68e34732c701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e255feb-df63-4e0b-9d9b-abe2204ec529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume bde2fcc4-e451-435d-86ad-43fd2a61478e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde2fcc4-e451-435d-86ad-43fd2a61478e', 'volume_size': 1}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Created reservations ['be6c4f50-f15e-495f-9507-c98eacdee3f3', '6f72f636-f815-4456-a32e-544b947124ca', '59aed197-9f3f-4da8-8173-7bec20cab158', 'f586e53a-445c-4a5a-93e1-7494a0ca755e'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:43 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a 1073741824" returned: 0 in 0.645s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:43 devstack sudo[105914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:43 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:43 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a
Sep 04 06:11:43 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (919d47ea-ce17-40de-a1fa-3578ab05ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73beaab3-03e1-4b13-92d9-9b20ff1c2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73beaab3-03e1-4b13-92d9-9b20ff1c2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276569857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a12677c-7894-49d0-af6e-d16c592077d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:44Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9517997a-15c3-4246-9e44-02df384d0525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9517997a-15c3-4246-9e44-02df384d0525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a9150-86e5-4a29-8da1-8d3981b7a622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d6a9150-86e5-4a29-8da1-8d3981b7a622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a12677c-7894-49d0-af6e-d16c592077d8', 'volume_name': 'volume-1a12677c-7894-49d0-af6e-d16c592077d8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb9f72d-c36d-474b-b3f1-523bc7f5767f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb9f72d-c36d-474b-b3f1-523bc7f5767f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25093f3e-617c-4b73-8fc8-c27516b1da83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume 1a12677c-7894-49d0-af6e-d16c592077d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a12677c-7894-49d0-af6e-d16c592077d8', 'volume_size': 1}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:44 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a" returned: 0 in 0.387s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.620s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1874028763',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde2fcc4-e451-435d-86ad-43fd2a61478e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:44Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume bde2fcc4-e451-435d-86ad-43fd2a61478e {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:44 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:44 devstack sudo[105920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e 1073741824
Sep 04 06:11:44 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f199d25a-382a-4107-85e9-fc3659c6d0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-168fa785-c107-45b5-8f8b-8403d953d13a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7366cd-aa2f-4787-a0de-e6981012b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Deleted volume successfully.
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-168fa785-c107-45b5-8f8b-8403d953d13a (168fa785-c107-45b5-8f8b-8403d953d13a): created successfully
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee7366cd-aa2f-4787-a0de-e6981012b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (e3273b1a-b45c-4b64-8dd9-ff83fd49ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8c578d39-d1f6-4d5a-b3f5-56eb95fe69c1 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-76c975c1-2c18-4ae9-a659-b61c5a512f1b tempest-VolumeAndVolumeTypeFromImageTest-322545982 None] Lock "cinder-452cd605-9b56-4ad0-ba85-73702d3407ce-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (16eee65a-b3a4-453d-b34f-d2caacc05387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5490e11c-1ed6-484f-a506-5c61087aab5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5490e11c-1ed6-484f-a506-5c61087aab5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343209976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621df49e-542b-483e-afba-8f1335d628b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:45Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3ac302-2833-47cf-a1df-1e4b5b4df2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3ac302-2833-47cf-a1df-1e4b5b4df2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c529b-8db4-4a10-8995-6228b3d751f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081c529b-8db4-4a10-8995-6228b3d751f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '621df49e-542b-483e-afba-8f1335d628b4', 'volume_name': 'volume-621df49e-542b-483e-afba-8f1335d628b4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3c8a9-08d2-45c9-b5e5-b75f193c84cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc3c8a9-08d2-45c9-b5e5-b75f193c84cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e4e148-c06c-489b-969a-e0a1ce2fbd7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume 621df49e-542b-483e-afba-8f1335d628b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-621df49e-542b-483e-afba-8f1335d628b4', 'volume_size': 1}
Sep 04 06:11:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:45 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e 1073741824" returned: 0 in 0.664s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:45 devstack sudo[105927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e
Sep 04 06:11:45 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (de21a0f3-69f1-46be-b54f-a8ff2abdc9a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afcdb149-76ab-430c-aca0-241e97eff9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afcdb149-76ab-430c-aca0-241e97eff9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773765193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494cbf3-e138-4e29-83e3-e875d095ad79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:45Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4727b0b5-1d88-405e-8b42-2d78c118de97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4727b0b5-1d88-405e-8b42-2d78c118de97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc9c7a3-d886-406f-9d22-4f05786d29d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc9c7a3-d886-406f-9d22-4f05786d29d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f494cbf3-e138-4e29-83e3-e875d095ad79', 'volume_name': 'volume-f494cbf3-e138-4e29-83e3-e875d095ad79', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbf0124-43d2-4e50-b294-db450e8e28e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bbf0124-43d2-4e50-b294-db450e8e28e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e4d14-2487-4f07-a08f-6fc87ebbcce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume f494cbf3-e138-4e29-83e3-e875d095ad79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f494cbf3-e138-4e29-83e3-e875d095ad79', 'volume_size': 1}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:45 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.177s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-276569857',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a12677c-7894-49d0-af6e-d16c592077d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:44Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume 1a12677c-7894-49d0-af6e-d16c592077d8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e255feb-df63-4e0b-9d9b-abe2204ec529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde2fcc4-e451-435d-86ad-43fd2a61478e', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack sudo[105930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 1073741824
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1eb0aed-aa2b-4589-92f5-c4197bfaaa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:45 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-bde2fcc4-e451-435d-86ad-43fd2a61478e (bde2fcc4-e451-435d-86ad-43fd2a61478e): created successfully
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1eb0aed-aa2b-4589-92f5-c4197bfaaa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (d7b4c14b-20a1-4902-af59-95b539f9238d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-296871be-1acb-49c5-9446-5331766cdd72 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:45 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 1073741824" returned: 0 in 0.503s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:46 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8
Sep 04 06:11:46 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:46 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8" returned: 0 in 0.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343209976',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=621df49e-542b-483e-afba-8f1335d628b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:45Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume 621df49e-542b-483e-afba-8f1335d628b4 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:46 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:46 devstack sudo[105939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 1073741824
Sep 04 06:11:46 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25093f3e-617c-4b73-8fc8-c27516b1da83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a12677c-7894-49d0-af6e-d16c592077d8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d06932-3507-4020-9842-ac25c772c0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-1a12677c-7894-49d0-af6e-d16c592077d8 (1a12677c-7894-49d0-af6e-d16c592077d8): created successfully
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7d06932-3507-4020-9842-ac25c772c0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (919d47ea-ce17-40de-a1fa-3578ab05ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-39e8a071-0756-4920-87ec-adfce5fb4f7a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:46 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 1073741824" returned: 0 in 0.526s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:46 devstack sudo[105944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4
Sep 04 06:11:46 devstack sudo[105944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:47 devstack sudo[105944]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.845s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1773765193',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f494cbf3-e138-4e29-83e3-e875d095ad79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='530559ccb34b468e836fd639fea6afb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:45Z,use_quota=True,user_id='369536c9c2de4f1e954e85c44122a108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Creating volume f494cbf3-e138-4e29-83e3-e875d095ad79 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3e4e148-c06c-489b-969a-e0a1ce2fbd7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-621df49e-542b-483e-afba-8f1335d628b4', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:47 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 1073741824
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bdf0a-0662-4fac-b7d8-220bf2a90ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:47 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-621df49e-542b-483e-afba-8f1335d628b4 (621df49e-542b-483e-afba-8f1335d628b4): created successfully
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4bdf0a-0662-4fac-b7d8-220bf2a90ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (16eee65a-b3a4-453d-b34f-d2caacc05387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7c162892-d9b5-4656-b334-5f94da04d9ea tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:47 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 1073741824" returned: 0 in 0.549s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:47 devstack sudo[105954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79
Sep 04 06:11:47 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:47 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52e4d14-2487-4f07-a08f-6fc87ebbcce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f494cbf3-e138-4e29-83e3-e875d095ad79', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae038c-c67d-4ea2-b1fa-94679c6333cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Volume volume-f494cbf3-e138-4e29-83e3-e875d095ad79 (f494cbf3-e138-4e29-83e3-e875d095ad79): created successfully
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01ae038c-c67d-4ea2-b1fa-94679c6333cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Flow 'volume_create_manager' (de21a0f3-69f1-46be-b54f-a8ff2abdc9a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cf767715-56d5-4535-a87a-a7993b312837 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created volume successfully.
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-f494cbf3-e138-4e29-83e3-e875d095ad79-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-f494cbf3-e138-4e29-83e3-e875d095ad79-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-f494cbf3-e138-4e29-83e3-e875d095ad79" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-f494cbf3-e138-4e29-83e3-e875d095ad79" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[079351ea-cb12-4199-ac71-a8d41bac6a0a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:48 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79
Sep 04 06:11:48 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:49 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:49 devstack sudo[105967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79
Sep 04 06:11:49 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (5501f7fe-c774-4526-b210-883eb1e7f2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bceb639-5b4d-4518-833b-6ce30924d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bceb639-5b4d-4518-833b-6ce30924d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162522601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6cf8ec-53af-41df-84a9-67b2d79e473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:49Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71deefcf-61d8-4061-b5c8-ff6c119cd9d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71deefcf-61d8-4061-b5c8-ff6c119cd9d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00db07fa-76cd-4688-afc3-6671a6ab4570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00db07fa-76cd-4688-afc3-6671a6ab4570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6cf8ec-53af-41df-84a9-67b2d79e473f', 'volume_name': 'volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d0d6a-3fb9-487c-9f2c-a64afef1474f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521d0d6a-3fb9-487c-9f2c-a64afef1474f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fbab5c-5f3b-4e0b-9a3c-0c2f574a9c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume 6f6cf8ec-53af-41df-84a9-67b2d79e473f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f', 'volume_size': 1}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1162522601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6cf8ec-53af-41df-84a9-67b2d79e473f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:49Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Creating volume 6f6cf8ec-53af-41df-84a9-67b2d79e473f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:49 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:49 devstack sudo[105969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f 1073741824
Sep 04 06:11:49 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:49 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f494cbf3-e138-4e29-83e3-e875d095ad79" returned: 0 in 0.335s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-f494cbf3-e138-4e29-83e3-e875d095ad79" released by "delete_volume" :: held 0.811s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['b22d88aa-3ef7-4f48-b953-0f99fa23d5a6', '4bf528ba-3744-4fcc-9d28-70369ca7c374', '3b8a0c48-2a04-42ae-bb14-3b32b9093e6a', 'bf7a13d5-4261-4946-bd69-3248f9276e54'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:49 devstack sudo[105975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:49 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (50aa7cf8-eb45-4c0b-bda2-603e11191008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6867a1e-56fe-4289-a734-82eb1c2165b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6867a1e-56fe-4289-a734-82eb1c2165b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768917884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c63a22-0655-464b-96db-c2c1c836ce8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:50Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ee84fd-c157-4e37-a4ac-2798b10d1b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ee84fd-c157-4e37-a4ac-2798b10d1b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32daecfe-b304-40ce-9304-ecf6e80ff7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32daecfe-b304-40ce-9304-ecf6e80ff7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c63a22-0655-464b-96db-c2c1c836ce8c', 'volume_name': 'volume-24c63a22-0655-464b-96db-c2c1c836ce8c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1eaf025-bf81-4752-9a4e-654d468049e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1eaf025-bf81-4752-9a4e-654d468049e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fa87c2-e8b8-4a32-9c03-cb4c5245aa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Volume 24c63a22-0655-464b-96db-c2c1c836ce8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c63a22-0655-464b-96db-c2c1c836ce8c', 'volume_size': 1}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-621df49e-542b-483e-afba-8f1335d628b4-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-621df49e-542b-483e-afba-8f1335d628b4-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:50 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f 1073741824" returned: 0 in 0.724s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:50 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-621df49e-542b-483e-afba-8f1335d628b4" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-621df49e-542b-483e-afba-8f1335d628b4" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfddba96-9cc5-4a63-98e6-e0e138331c13]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6921ce9b-81cf-4bfd-ba85-0e090963c7c8 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-f494cbf3-e138-4e29-83e3-e875d095ad79-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:50 devstack sudo[105981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f
Sep 04 06:11:50 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (75a7ed0d-9057-4b8b-b2da-4d4f3f8f3299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b5d3ad-7238-4a03-8883-89a76d1563c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b5d3ad-7238-4a03-8883-89a76d1563c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333841390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba82460-4217-409c-97f3-17e50f2425e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:50Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212dd3e-f6a5-427f-83a9-b029a47407d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1212dd3e-f6a5-427f-83a9-b029a47407d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c025ebdf-9a41-4ff6-bca4-2b4bd2f5961f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c025ebdf-9a41-4ff6-bca4-2b4bd2f5961f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba82460-4217-409c-97f3-17e50f2425e2', 'volume_name': 'volume-cba82460-4217-409c-97f3-17e50f2425e2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack sudo[105980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4
Sep 04 06:11:50 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da86d0f-1b46-49ad-b776-f08852381355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2da86d0f-1b46-49ad-b776-f08852381355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71479b-5894-4445-8b81-ff607cf37d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Volume cba82460-4217-409c-97f3-17e50f2425e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba82460-4217-409c-97f3-17e50f2425e2', 'volume_size': 1}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:50 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1768917884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c63a22-0655-464b-96db-c2c1c836ce8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:50Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Creating volume 24c63a22-0655-464b-96db-c2c1c836ce8c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:50 devstack sudo[105985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c 1073741824
Sep 04 06:11:50 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6fbab5c-5f3b-4e0b-9a3c-0c2f574a9c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0cabad-0afd-4929-87dd-9dcab6dffc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f (6f6cf8ec-53af-41df-84a9-67b2d79e473f): created successfully
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0cabad-0afd-4929-87dd-9dcab6dffc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (5501f7fe-c774-4526-b210-883eb1e7f2e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7dc5fe78-33e2-4c95-9502-b0595947c1b3 tempest-CreateVolumesFromImageTest-2133075211 None] Created volume successfully.
Sep 04 06:11:50 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4" returned: 0 in 0.520s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:50 devstack sudo[105990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4
Sep 04 06:11:50 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:51 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-621df49e-542b-483e-afba-8f1335d628b4" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-621df49e-542b-483e-afba-8f1335d628b4" released by "delete_volume" :: held 0.931s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:51 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (570d4ed2-7e18-4ca0-bcbf-5ebd375187e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777866c4-31a3-4b03-bda6-77bd52b74840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c 1073741824" returned: 0 in 0.558s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (777866c4-31a3-4b03-bda6-77bd52b74840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2065782874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d596297-0606-4313-ab3a-7415db1ce862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:51Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6db222f-77e6-46b4-a8db-e510101aaac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6db222f-77e6-46b4-a8db-e510101aaac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb97c41-6be1-4ad8-a2ab-2c5657df6613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb97c41-6be1-4ad8-a2ab-2c5657df6613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d596297-0606-4313-ab3a-7415db1ce862', 'volume_name': 'volume-9d596297-0606-4313-ab3a-7415db1ce862', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f8e651-92e4-4a96-80a0-4493621737c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f8e651-92e4-4a96-80a0-4493621737c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70363873-27fe-4403-895c-43a470d9408a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume 9d596297-0606-4313-ab3a-7415db1ce862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d596297-0606-4313-ab3a-7415db1ce862', 'volume_size': 1}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['6d69aaa9-78bc-4575-b738-ccf43fbb3a57', 'f513ec30-d888-487e-9efc-0c1d5835054c', '01975c7a-370e-4c6b-8381-62f903104559', '43c1b2c9-722e-4767-896d-774a4413b4da'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:51 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c
Sep 04 06:11:51 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:51 devstack sudo[106000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:51 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (bc5b0e27-d52d-4df9-b664-209d02d406f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b01a798-bcf5-49e8-a3e3-76a132fb2ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b01a798-bcf5-49e8-a3e3-76a132fb2ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143473286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbdd4b1-2321-40fc-b81a-47303e3e0f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:51Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185d8b9-9e5b-45db-ab75-bd3e03e5c7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a185d8b9-9e5b-45db-ab75-bd3e03e5c7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dcb246-5b65-4501-86cf-d987d9de8e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4dcb246-5b65-4501-86cf-d987d9de8e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bbdd4b1-2321-40fc-b81a-47303e3e0f66', 'volume_name': 'volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76916031-3b86-4b4b-86ee-f102d912bb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76916031-3b86-4b4b-86ee-f102d912bb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ab5f30-a49c-407b-9475-eabfc85ad4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Volume 7bbdd4b1-2321-40fc-b81a-47303e3e0f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66', 'volume_size': 1}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333841390',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba82460-4217-409c-97f3-17e50f2425e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:50Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Creating volume cba82460-4217-409c-97f3-17e50f2425e2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:51 devstack sudo[106004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 1073741824
Sep 04 06:11:51 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08fa87c2-e8b8-4a32-9c03-cb4c5245aa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c63a22-0655-464b-96db-c2c1c836ce8c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b443f5-0c71-4f32-8edf-c492a3785abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:51 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Volume volume-24c63a22-0655-464b-96db-c2c1c836ce8c (24c63a22-0655-464b-96db-c2c1c836ce8c): created successfully
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b443f5-0c71-4f32-8edf-c492a3785abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (50aa7cf8-eb45-4c0b-bda2-603e11191008) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4ffe4710-0a95-4283-bfb7-af497462e0d0 tempest-CreateVolumesFromImageTest-2133075211 None] Created volume successfully.
Sep 04 06:11:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-97345492-6e3a-43e5-819c-cfb1263ec427 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-621df49e-542b-483e-afba-8f1335d628b4-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:52 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 1073741824" returned: 0 in 0.423s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:52 devstack sudo[106010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2
Sep 04 06:11:52 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-1a12677c-7894-49d0-af6e-d16c592077d8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-1a12677c-7894-49d0-af6e-d16c592077d8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:52 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2065782874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d596297-0606-4313-ab3a-7415db1ce862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:51Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Creating volume 9d596297-0606-4313-ab3a-7415db1ce862 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-1a12677c-7894-49d0-af6e-d16c592077d8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:52 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 1073741824
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc71479b-5894-4445-8b81-ff607cf37d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba82460-4217-409c-97f3-17e50f2425e2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:52 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df521a9-461f-4417-bd1b-6dabe79fb5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Volume volume-cba82460-4217-409c-97f3-17e50f2425e2 (cba82460-4217-409c-97f3-17e50f2425e2): created successfully
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df521a9-461f-4417-bd1b-6dabe79fb5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (75a7ed0d-9057-4b8b-b2da-4d4f3f8f3299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-1a12677c-7894-49d0-af6e-d16c592077d8" acquired by "delete_volume" :: waited 0.062s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-692a9831-2612-4238-a4bd-78fb31e81b26 tempest-CreateVolumesFromImageTest-2133075211 None] Created volume successfully.
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[1071f7ef-a929-4ef4-84f1-b5e94b25ad82]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:52 devstack sudo[106015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8
Sep 04 06:11:52 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:52 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 1073741824" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:52 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862
Sep 04 06:11:52 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:52 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:52 devstack sudo[106025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8
Sep 04 06:11:52 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:53 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143473286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bbdd4b1-2321-40fc-b81a-47303e3e0f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='444643eca8b040b28470155ea91cefc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:11:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:11:51Z,use_quota=True,user_id='37a7aea762704047b5e37a8ae89e73a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Creating volume 7bbdd4b1-2321-40fc-b81a-47303e3e0f66 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70363873-27fe-4403-895c-43a470d9408a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d596297-0606-4313-ab3a-7415db1ce862', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb9f580-5492-48f7-a331-9b2b13e74c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:53 devstack sudo[106029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 1073741824
Sep 04 06:11:53 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Volume volume-9d596297-0606-4313-ab3a-7415db1ce862 (9d596297-0606-4313-ab3a-7415db1ce862): created successfully
Sep 04 06:11:53 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cb9f580-5492-48f7-a331-9b2b13e74c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (570d4ed2-7e18-4ca0-bcbf-5ebd375187e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a12677c-7894-49d0-af6e-d16c592077d8" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c5f91cd1-21ae-4cb8-8840-86eb152a25c3 tempest-CreateVolumesFromImageTest-2133075211 None] Created volume successfully.
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-1a12677c-7894-49d0-af6e-d16c592077d8" released by "delete_volume" :: held 0.727s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['b9d69a12-4b99-4933-8a5a-c84eceb68249', '642bfb3a-90dd-4139-8a5e-6943a6b15a27', 'adaf1d3c-c185-446c-ab62-e74120403845', 'e3c73c9f-04ac-4714-9b00-e00609640b7a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:53 devstack sudo[106031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:53 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-bde2fcc4-e451-435d-86ad-43fd2a61478e-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-bde2fcc4-e451-435d-86ad-43fd2a61478e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:53 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-bde2fcc4-e451-435d-86ad-43fd2a61478e" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:53 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-bde2fcc4-e451-435d-86ad-43fd2a61478e" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 1073741824" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-00e7055e-78a9-4807-85f2-c6dfc6137171 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-1a12677c-7894-49d0-af6e-d16c592077d8-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc088acc-7333-4498-8cd9-486fa36fa373]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:53 devstack sudo[106039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66
Sep 04 06:11:53 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:53 devstack sudo[106038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e
Sep 04 06:11:53 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:53 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ab5f30-a49c-407b-9475-eabfc85ad4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6273cfc-23e4-499d-b3a5-dc0062ead5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Volume volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 (7bbdd4b1-2321-40fc-b81a-47303e3e0f66): created successfully
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6273cfc-23e4-499d-b3a5-dc0062ead5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Flow 'volume_create_manager' (bc5b0e27-d52d-4df9-b664-209d02d406f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:11:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ebd3e37a-4323-4355-9cb6-a5d76c41d018 tempest-CreateVolumesFromImageTest-2133075211 None] Created volume successfully.
Sep 04 06:11:53 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:54 devstack sudo[106046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e
Sep 04 06:11:54 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:54 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bde2fcc4-e451-435d-86ad-43fd2a61478e" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-bde2fcc4-e451-435d-86ad-43fd2a61478e" released by "delete_volume" :: held 0.702s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['7585a4c0-7612-4bb5-aa70-a9db4bc2d08e', 'a861fa4a-b567-4746-8ac9-c8f61cc7f20b', 'e06c6155-1721-4ea8-a139-5a03b4d9b86d', 'd02c7c99-36ec-4167-8f56-090179a00734'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:54 devstack sudo[106049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:54 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-168fa785-c107-45b5-8f8b-8403d953d13a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:54 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-168fa785-c107-45b5-8f8b-8403d953d13a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0b227cd6-6a16-48d1-a9df-43e970aa56d7 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-bde2fcc4-e451-435d-86ad-43fd2a61478e-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-168fa785-c107-45b5-8f8b-8403d953d13a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-168fa785-c107-45b5-8f8b-8403d953d13a" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9b8bf4-54e9-4be5-8d30-0a2dae6ceb7e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:54 devstack sudo[106052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a
Sep 04 06:11:54 devstack sudo[106052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-7bbdd4b1-2321-40fc-b81a-47303e3e0f66-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-7bbdd4b1-2321-40fc-b81a-47303e3e0f66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-quobyte-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[70035542-dfa2-4bf2-9944-f66d937d6b5b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:55 devstack sudo[106054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66
Sep 04 06:11:55 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:55 devstack sudo[106052]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:55 devstack sudo[106059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a
Sep 04 06:11:55 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:55 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:55 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66
Sep 04 06:11:55 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:55 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-168fa785-c107-45b5-8f8b-8403d953d13a" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-168fa785-c107-45b5-8f8b-8403d953d13a" released by "delete_volume" :: held 0.706s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['e1268392-a608-4073-bf3c-04b81e86de78', 'f6bb1f8c-489b-42d2-9b49-6fc69d10fee0', 'dc6e77f8-622f-407a-816a-d3e9e1198eaf', '1254645b-b62e-4098-9570-ca117044d2ff'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:55 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:55 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:55 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-7bbdd4b1-2321-40fc-b81a-47303e3e0f66" released by "delete_volume" :: held 0.683s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Created reservations ['61a50f70-4917-49a2-b80f-c96e9c5bbaf4', '5f46486c-cf44-4812-b314-d43e583274f1', 'e96e8223-429b-48d6-b461-941921316254', 'eede0747-105c-4128-8644-7ab02339a56c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-49569add-a199-4656-9c75-bee7ef7b0c55-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:55 devstack sudo[106070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:55 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-49569add-a199-4656-9c75-bee7ef7b0c55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-49569add-a199-4656-9c75-bee7ef7b0c55" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:55 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-49569add-a199-4656-9c75-bee7ef7b0c55" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleting offline snapshot 49569add-a199-4656-9c75-bee7ef7b0c55 of volume d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] snapshot_file for this snap is: volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[081cecdb-db7c-4d89-92fe-e7001a69e198]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e7c6714-9bfb-4ff7-94b9-d78d4726c7b5 tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-168fa785-c107-45b5-8f8b-8403d953d13a-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-9d596297-0606-4313-ab3a-7415db1ce862-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-9d596297-0606-4313-ab3a-7415db1ce862-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:56 devstack sudo[106073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55
Sep 04 06:11:56 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-quobyte-9d596297-0606-4313-ab3a-7415db1ce862" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:56 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.340s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Deleted volume successfully.
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-9d596297-0606-4313-ab3a-7415db1ce862" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c51ac1be-178d-4521-9272-e55a4be9b941 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-7bbdd4b1-2321-40fc-b81a-47303e3e0f66-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d40716-2288-402a-a93e-63ada7fc9f8a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:56 devstack sudo[106076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862
Sep 04 06:11:56 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:56 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d84231c9-b5cd-4e69-a17b-6ec775264224(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[49786a28-615c-4d89-bda5-66e7b3979a4d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:56 devstack sudo[106081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224
Sep 04 06:11:56 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:56 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:56 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862
Sep 04 06:11:56 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:56 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:56 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d596297-0606-4313-ab3a-7415db1ce862" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:56 devstack sudo[106092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55
Sep 04 06:11:56 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-9d596297-0606-4313-ab3a-7415db1ce862" released by "delete_volume" :: held 0.705s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:56 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Created reservations ['d9b094e3-c647-499e-89f2-a11de3281b37', '39c544f2-bcee-4bb5-8a82-5ef6472f9371', '76bce190-0f7d-4c48-9305-fa7908350e3e', '3d46e957-81b8-41d5-a978-3db9c8d5b706'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:57 devstack sudo[106094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:57 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:57 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:57 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55
Sep 04 06:11:57 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:57 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-cba82460-4217-409c-97f3-17e50f2425e2-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Deleted volume successfully.
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-cba82460-4217-409c-97f3-17e50f2425e2-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-4f00fc56-8d36-499d-b23e-e6515cbbe0bf tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-9d596297-0606-4313-ab3a-7415db1ce862-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-quobyte-cba82460-4217-409c-97f3-17e50f2425e2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-cba82460-4217-409c-97f3-17e50f2425e2" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa050e7-c5eb-4e58-928f-ba45a72eba3d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:57 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224.49569add-a199-4656-9c75-bee7ef7b0c55" returned: 0 in 0.294s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:57 devstack sudo[106102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2
Sep 04 06:11:57 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-49569add-a199-4656-9c75-bee7ef7b0c55" released by "_delete_snapshot" :: held 1.645s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" released by "delete_snapshot" :: held 1.674s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['3e7a5942-354f-4ba9-a62b-a1e46483cd2c', '86441bb9-6095-4d5f-8de1-8c1fc2528f5d', 'fb8f9bd9-83bd-4d99-8f74-86a56be065a5', '49cb0e0c-d212-4a84-8dbc-e75a5b0b4f14'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Delete snapshot completed successfully.
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-6d5cf06e-ac29-46c0-91b5-09532112888c tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-49569add-a199-4656-9c75-bee7ef7b0c55-delete_snapshot" released by "delete_snapshot" :: held 1.820s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:57 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:57 devstack sudo[106108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2
Sep 04 06:11:57 devstack sudo[106108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-d84231c9-b5cd-4e69-a17b-6ec775264224-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-d84231c9-b5cd-4e69-a17b-6ec775264224-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:58 devstack sudo[106108]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cba82460-4217-409c-97f3-17e50f2425e2" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-cba82460-4217-409c-97f3-17e50f2425e2" released by "delete_volume" :: held 0.695s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc4a6e5-6d18-4b76-9ce4-d292297dc053]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Created reservations ['159ce2de-879e-441f-810c-8cd0a000bf8c', 'ecfb43a3-dbf9-4718-95ad-508edcbeec3c', '030d7751-2d65-441f-adba-fdbe154b8e71', 'e93f78f8-5e8e-4aaf-847a-051892675728'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:58 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224
Sep 04 06:11:58 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:58 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:58 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-24c63a22-0655-464b-96db-c2c1c836ce8c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-24c63a22-0655-464b-96db-c2c1c836ce8c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-quobyte-24c63a22-0655-464b-96db-c2c1c836ce8c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-24c63a22-0655-464b-96db-c2c1c836ce8c" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e0c2cf-3054-470c-a232-0be2a07f9e8e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:58 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224" returned: 0 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:58 devstack sudo[106120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224
Sep 04 06:11:58 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:58 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.337s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Deleted volume successfully.
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1e86d71c-6ab7-45e0-8d8c-a375a902765d tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-cba82460-4217-409c-97f3-17e50f2425e2-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:58 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c
Sep 04 06:11:58 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:58 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d84231c9-b5cd-4e69-a17b-6ec775264224" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-quobyte-d84231c9-b5cd-4e69-a17b-6ec775264224" released by "delete_volume" :: held 0.803s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:58 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c" returned: 0 in 0.370s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:58 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Created reservations ['9b8515b2-e900-412d-b1d6-06bd9d87e982', '64f4bcd8-a9c2-41b4-ab79-ff4f706c1c2e', '941f2b8f-7e23-4daa-b8cf-f172c4fee3bb', '89697150-bda4-4a5e-b80b-627b9faaa056'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:58 devstack sudo[106127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c
Sep 04 06:11:58 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:59 devstack sudo[106129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:59 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:59 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-24c63a22-0655-464b-96db-c2c1c836ce8c" returned: 0 in 0.278s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-24c63a22-0655-464b-96db-c2c1c836ce8c" released by "delete_volume" :: held 0.703s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Created reservations ['7904323f-99e6-4147-86f7-fb82954e1d29', '58ef3231-37a9-4f29-a89d-3414165c2a67', '5157891e-1e63-4688-a008-4be3ace5264e', 'e6900185-3bc2-4a40-be49-9fe6c41bb458'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:11:59 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Deleted volume successfully.
Sep 04 06:11:59 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:11:59 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d1f76816-7e5f-438d-b068-78820694b91a tempest-CreateVolumesFromSnapshotTest-1006063863 None] Lock "cinder-d84231c9-b5cd-4e69-a17b-6ec775264224-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-6f6cf8ec-53af-41df-84a9-67b2d79e473f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-6f6cf8ec-53af-41df-84a9-67b2d79e473f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:59 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "cinder-quobyte-6f6cf8ec-53af-41df-84a9-67b2d79e473f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.325s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:11:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Deleted volume successfully.
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-6f6cf8ec-53af-41df-84a9-67b2d79e473f" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-fac340cf-18da-48f0-9833-199ce3537299 tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-24c63a22-0655-464b-96db-c2c1c836ce8c-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfd61c2-a1bd-49ef-a5dd-9ab702e77935]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:11:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:11:59 devstack sudo[106136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f
Sep 04 06:11:59 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:00 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:00 devstack sudo[106141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f
Sep 04 06:12:00 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:00 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-6f6cf8ec-53af-41df-84a9-67b2d79e473f" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-quobyte-6f6cf8ec-53af-41df-84a9-67b2d79e473f" released by "delete_volume" :: held 0.767s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Created reservations ['d0227d19-9c0a-47eb-8226-27ff372e03af', '4d77d5cc-2269-4799-bb53-ef86f93f8618', '85eb1030-350b-46ce-8d7c-c1615a060b7f', '005c6942-984c-4f26-b567-613643c9ad9c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:00 devstack sudo[106144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:00 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:00 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:00 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Deleted volume successfully.
Sep 04 06:12:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2bdf4cec-d441-4ec6-8ae5-40abbafd545a tempest-CreateVolumesFromImageTest-2133075211 None] Lock "cinder-6f6cf8ec-53af-41df-84a9-67b2d79e473f-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Flow 'volume_create_manager' (7148d889-7837-4b1b-8d35-d80d6c40ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de225626-b802-432b-b4ba-53c7c476165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de225626-b802-432b-b4ba-53c7c476165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094971671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06065edb1c69488288c5433e334b1d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:04Z,use_quota=True,user_id='b8463e2661f0420aa34c7ab3ba8e4522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb077b-a8f4-4ac9-8fc1-52d879df3924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ceb077b-a8f4-4ac9-8fc1-52d879df3924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d891094f-19fd-4c88-9c59-f28dfb02b11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d891094f-19fd-4c88-9c59-f28dfb02b11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8f820fe-5a91-4cc6-a16d-7526ec3b6ce0', 'volume_name': 'volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00012fb2-dc3d-4e10-ad1d-1c5983b2b6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00012fb2-dc3d-4e10-ad1d-1c5983b2b6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f35a0-99a4-41c8-97e6-d83c3de8f7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Volume d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0', 'volume_size': 1}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094971671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06065edb1c69488288c5433e334b1d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:04Z,use_quota=True,user_id='b8463e2661f0420aa34c7ab3ba8e4522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Creating volume d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:04 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:04 devstack sudo[106148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 1073741824
Sep 04 06:12:04 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:04 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 1073741824" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:04 devstack sudo[106154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:04 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:05 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4f35a0-99a4-41c8-97e6-d83c3de8f7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cab1f3-82fe-4129-bdbd-8cda454de900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Volume volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 (d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0): created successfully
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3cab1f3-82fe-4129-bdbd-8cda454de900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Flow 'volume_create_manager' (7148d889-7837-4b1b-8d35-d80d6c40ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-01be9481-0977-4e7b-9a73-f981b6d5d069 tempest-VolumeDependencyTests-1831743380 None] Created volume successfully.
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Creating offline snapshot ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 of volume d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ae1e38-05b5-4ce5-a73c-07191e3a3616]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:06 devstack sudo[106158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:06 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:06 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.403s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:06 devstack sudo[106164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 1G
Sep 04 06:12:06 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:07 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 1G" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:07 devstack sudo[106169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:07 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:07 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:07 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 is being set with open permissions: ugo+rw
Sep 04 06:12:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:07 devstack sudo[106175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:07 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:07 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:08 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info
Sep 04 06:12:08 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:08 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:08 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info is being set with open permissions: ugo+rw
Sep 04 06:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:08 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info
Sep 04 06:12:08 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.info" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.161s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6b141e45-0a99-4f45-a196-4bb0d73d013f tempest-VolumeDependencyTests-1831743380 None] Create snapshot completed successfully
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Flow 'volume_create_manager' (b78608b9-2d20-4b9c-85d7-5544a9379221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02b4f58-576d-40b4-9830-bcc6796ccfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02b4f58-576d-40b4-9830-bcc6796ccfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-724110303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa0608c-edef-486e-b48e-572a650681e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06065edb1c69488288c5433e334b1d31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea486b9d-f6d3-4955-bc2c-fda4d2a352d2,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:10Z,use_quota=True,user_id='b8463e2661f0420aa34c7ab3ba8e4522',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e188eb45-95aa-428f-ac5b-b1ed0bf27c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e188eb45-95aa-428f-ac5b-b1ed0bf27c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a944bd2-e44f-418e-93af-4ef2f1edebd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a944bd2-e44f-418e-93af-4ef2f1edebd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cfa0608c-edef-486e-b48e-572a650681e7', 'volume_name': 'volume-cfa0608c-edef-486e-b48e-572a650681e7', 'volume_size': 1, 'snapshot_id': 'ea486b9d-f6d3-4955-bc2c-fda4d2a352d2'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607013f2-7297-4cc6-bd28-9a2263f15200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (607013f2-7297-4cc6-bd28-9a2263f15200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bda4d8-d281-4682-933d-ad70822d649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Volume cfa0608c-edef-486e-b48e-572a650681e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cfa0608c-edef-486e-b48e-572a650681e7', 'volume_size': 1, 'snapshot_id': 'ea486b9d-f6d3-4955-bc2c-fda4d2a352d2'}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-cfa0608c-edef-486e-b48e-572a650681e7" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-cfa0608c-edef-486e-b48e-572a650681e7" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Creating volume cfa0608c-edef-486e-b48e-572a650681e7 from snapshot ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] snapshot: ea486b9d-f6d3-4955-bc2c-fda4d2a352d2, volume: cfa0608c-edef-486e-b48e-572a650681e7,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e513c-4e7f-4652-b6ff-a225c97722e5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:10 devstack sudo[106185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:10 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:10 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[45620b2b-b1ce-40f6-9695-1424b34bc3f1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:10 devstack sudo[106191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:10 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:11 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.394s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:12:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:12:11 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:12:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:11 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7
Sep 04 06:12:11 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:12 devstack sudo[106211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:12 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:13 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.615s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:12:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:12:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (1594efab-84be-49c6-b2b4-5d9c7112fa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010fdb2d-e3e7-4b67-a436-1a5c2dd2be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010fdb2d-e3e7-4b67-a436-1a5c2dd2be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143485365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece1803-7f1d-4441-8512-01f78bbf3ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:15Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cbb5c5-fac0-4db8-ba7e-bb33894262cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32cbb5c5-fac0-4db8-ba7e-bb33894262cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b990e70-427c-4be1-86a7-492401b6b9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b990e70-427c-4be1-86a7-492401b6b9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bece1803-7f1d-4441-8512-01f78bbf3ad9', 'volume_name': 'volume-bece1803-7f1d-4441-8512-01f78bbf3ad9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e19a77-0a46-4ce2-821b-0e7159e19124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74e19a77-0a46-4ce2-821b-0e7159e19124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4392b12a-7de4-4476-95dd-35256cab3946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:15 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Volume bece1803-7f1d-4441-8512-01f78bbf3ad9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bece1803-7f1d-4441-8512-01f78bbf3ad9', 'volume_size': 1}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:15 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7" returned: 0 in 4.656s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:12:15 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Converted 1024.00 MB image at 219.90 MB/s
Sep 04 06:12:15 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 is being set with open permissions: ugo+rw
Sep 04 06:12:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:15 devstack sudo[106215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7
Sep 04 06:12:15 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:16 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" released by "_copy_volume_from_snapshot" :: held 5.744s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-cfa0608c-edef-486e-b48e-572a650681e7" released by "_create_volume_from_snapshot" :: held 5.817s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.839s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.743s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143485365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bece1803-7f1d-4441-8512-01f78bbf3ad9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:15Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Creating volume bece1803-7f1d-4441-8512-01f78bbf3ad9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:16 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:16 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 1073741824
Sep 04 06:12:16 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6bda4d8-d281-4682-933d-ad70822d649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa0608c-edef-486e-b48e-572a650681e7', 'volume_size': 1, 'snapshot_id': 'ea486b9d-f6d3-4955-bc2c-fda4d2a352d2'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2c0a16-0583-43d2-8bba-5ff53518f975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Volume volume-cfa0608c-edef-486e-b48e-572a650681e7 (cfa0608c-edef-486e-b48e-572a650681e7): created successfully
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2c0a16-0583-43d2-8bba-5ff53518f975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Flow 'volume_create_manager' (b78608b9-2d20-4b9c-85d7-5544a9379221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-42865f2a-aa14-403f-a7b2-4ac3643092a1 tempest-VolumeDependencyTests-1831743380 None] Created volume successfully.
Sep 04 06:12:16 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 1073741824" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:16 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9
Sep 04 06:12:16 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:16 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4392b12a-7de4-4476-95dd-35256cab3946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bece1803-7f1d-4441-8512-01f78bbf3ad9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea5c7ef-d9a0-4a7d-aa91-d33bca799a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:16 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Volume volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 (bece1803-7f1d-4441-8512-01f78bbf3ad9): created successfully
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea5c7ef-d9a0-4a7d-aa91-d33bca799a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (1594efab-84be-49c6-b2b4-5d9c7112fa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-75e530f6-2f11-4169-899e-98c1e4753565 tempest-ProjectReaderTests-182387073 None] Created volume successfully.
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Deleting offline snapshot ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 of volume d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] snapshot_file for this snap is: volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[825d5be9-f6ff-4e98-ad66-89d509c0e70f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:17 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:17 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:17 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e33040-5e8a-4e65-af74-6fadab5705e8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:17 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:17 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-bece1803-7f1d-4441-8512-01f78bbf3ad9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "cinder-bece1803-7f1d-4441-8512-01f78bbf3ad9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-quobyte-bece1803-7f1d-4441-8512-01f78bbf3ad9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-bece1803-7f1d-4441-8512-01f78bbf3ad9" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6159be-6313-476c-bddc-754c7027783a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:17 devstack sudo[106235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9
Sep 04 06:12:17 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:17 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.538s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:17 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:17 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:17 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9" returned: 0 in 0.367s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:17 devstack sudo[106245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9
Sep 04 06:12:17 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:18 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-bece1803-7f1d-4441-8512-01f78bbf3ad9" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-bece1803-7f1d-4441-8512-01f78bbf3ad9" released by "delete_volume" :: held 0.658s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:18 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:18 devstack sudo[106252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Created reservations ['bd8f26e9-fe73-4dde-bd6f-f03f2b40c72b', '04fabb24-e295-4fd6-b810-717b956f22b0', '66ced854-a9aa-4250-bfd8-feabfde95331', 'fcb82a4d-cfc3-4e38-84c1-54cecabb66a0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:18 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:18 devstack sudo[106254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:18 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:18 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0.ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2" released by "_delete_snapshot" :: held 1.608s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" released by "delete_snapshot" :: held 1.636s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Created reservations ['d7e9d57a-590f-466c-9bc1-ccb111d3dc88', 'af72a71f-9178-429b-96e3-56113a4c5924', 'b9502861-6d22-4d70-9e8a-500023e03bc9', '57f2961f-9e99-471c-973c-ba81836fa40c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:18 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Deleted volume successfully.
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994c32ae-fded-4424-8dd5-76f2f96deda7 tempest-ProjectReaderTests-182387073 None] Lock "cinder-bece1803-7f1d-4441-8512-01f78bbf3ad9-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Delete snapshot completed successfully.
Sep 04 06:12:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-63be20fe-a7e6-44a3-b918-59ad341a5fd2 tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-ea486b9d-f6d3-4955-bc2c-fda4d2a352d2-delete_snapshot" released by "delete_snapshot" :: held 1.844s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d40a1a-2243-4e2c-80ec-9d52ef6e45ef]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (72e75dbc-7e44-4345-a26b-d5e2c850e8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f5456c-05c6-4005-9289-18b661aaf9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f5456c-05c6-4005-9289-18b661aaf9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2098592091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b8a359-86c7-443e-bfed-ecf6ddeb72cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:19Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25150b8-1942-46fa-b868-5fc8dfea160b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25150b8-1942-46fa-b868-5fc8dfea160b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacbf926-8d0a-4a75-a33f-cc554763f76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacbf926-8d0a-4a75-a33f-cc554763f76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b8a359-86c7-443e-bfed-ecf6ddeb72cd', 'volume_name': 'volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2755dce2-70f4-4631-b65b-87216f13d8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2755dce2-70f4-4631-b65b-87216f13d8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4409a2f-98ba-4bd6-97b7-be1b9e41598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Volume d3b8a359-86c7-443e-bfed-ecf6ddeb72cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd', 'volume_size': 1}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2098592091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b8a359-86c7-443e-bfed-ecf6ddeb72cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:19Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Creating volume d3b8a359-86c7-443e-bfed-ecf6ddeb72cd {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:19 devstack sudo[106258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:19 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:19 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:19 devstack sudo[106260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd 1073741824
Sep 04 06:12:19 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:19 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:19 devstack sudo[106268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0
Sep 04 06:12:19 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:19 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd 1073741824" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:19 devstack sudo[106270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd
Sep 04 06:12:19 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:19 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0" released by "delete_volume" :: held 0.681s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Created reservations ['0bca9076-9c88-4c27-bc94-45f5bbeed9b6', '6f471826-7ceb-4d46-8843-c0e52ce4dc77', 'cb07ae97-42c6-48b9-b573-1a38110485c6', '0c9448bb-9240-42ec-b9b2-699347300de1'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:19 devstack sudo[106273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:19 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:19 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4409a2f-98ba-4bd6-97b7-be1b9e41598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fc6557-18b6-4a91-a46b-e742546dc11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Volume volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd (d3b8a359-86c7-443e-bfed-ecf6ddeb72cd): created successfully
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fc6557-18b6-4a91-a46b-e742546dc11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (72e75dbc-7e44-4345-a26b-d5e2c850e8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e03feae-13df-422c-bd1e-f6f70a80a9bd tempest-ProjectReaderTests-182387073 None] Created volume successfully.
Sep 04 06:12:20 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Deleted volume successfully.
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-d12adfe2-6871-4b85-a49f-42ff4b2c11fe tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-d8f820fe-5a91-4cc6-a16d-7526ec3b6ce0-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-cfa0608c-edef-486e-b48e-572a650681e7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "cinder-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-cfa0608c-edef-486e-b48e-572a650681e7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-quobyte-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75b9d2d-0620-413e-ba65-18a626772aba]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e166fd85-3847-4e9c-9da3-6cf43feadb7a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:20 devstack sudo[106277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd
Sep 04 06:12:20 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:20 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7
Sep 04 06:12:20 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:20 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:20 devstack sudo[106286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd
Sep 04 06:12:20 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:20 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:20 devstack sudo[106289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7
Sep 04 06:12:20 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:20 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd" released by "delete_volume" :: held 0.632s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:20 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cfa0608c-edef-486e-b48e-572a650681e7" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Created reservations ['bdfb7d55-8a4c-4a5c-98cb-02c5f4dfd443', 'f82f2b3f-6605-4fb8-93c5-04fd277278b0', '3cb3ab32-df3b-45c7-a65b-cc970bd494f5', '18ee3b8b-c02b-4394-a20b-7309cf5c84a9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-quobyte-cfa0608c-edef-486e-b48e-572a650681e7" released by "delete_volume" :: held 0.646s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Created reservations ['cfc8af30-546a-49cb-9979-cf821d4d17c2', '8471b3a2-3d3c-4832-a0a3-612e35858fa4', 'bdcb418b-7231-47c7-a24f-6295e658ed2a', 'e370ec9e-469f-4906-9ede-7fe19d585be6'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:21 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:21 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:21 devstack sudo[106296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:21 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:21 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Deleted volume successfully.
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-65db02c9-1fb7-46b4-b356-39077c0253b8 tempest-ProjectReaderTests-182387073 None] Lock "cinder-d3b8a359-86c7-443e-bfed-ecf6ddeb72cd-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:21 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Deleted volume successfully.
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d532438-762c-4ca7-8e4f-776b1207c21e tempest-VolumeDependencyTests-1831743380 None] Lock "cinder-cfa0608c-edef-486e-b48e-572a650681e7-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (c0af882e-1064-46c4-b3bb-dbcce03c2eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4383e5-0c71-40a8-ae6e-39ffa23ee9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e4383e5-0c71-40a8-ae6e-39ffa23ee9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877087010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27397a7f-f581-4329-87d7-b2f429f58d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:22Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bf739d-a136-41e8-88c0-348c92071f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26bf739d-a136-41e8-88c0-348c92071f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81222628-78d8-4550-8752-246dafca8909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81222628-78d8-4550-8752-246dafca8909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27397a7f-f581-4329-87d7-b2f429f58d02', 'volume_name': 'volume-27397a7f-f581-4329-87d7-b2f429f58d02', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f9fdd-f7bd-4356-944f-8b450d4cd4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f9fdd-f7bd-4356-944f-8b450d4cd4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3594bfce-f7c0-403e-a44f-4c4083ec4e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:21 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Volume 27397a7f-f581-4329-87d7-b2f429f58d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27397a7f-f581-4329-87d7-b2f429f58d02', 'volume_size': 1}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1877087010',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27397a7f-f581-4329-87d7-b2f429f58d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:22Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Creating volume 27397a7f-f581-4329-87d7-b2f429f58d02 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:21 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:21 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 1073741824
Sep 04 06:12:21 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:22 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 1073741824" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:22 devstack sudo[106306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02
Sep 04 06:12:22 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:22 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02" returned: 0 in 0.257s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3594bfce-f7c0-403e-a44f-4c4083ec4e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27397a7f-f581-4329-87d7-b2f429f58d02', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d053e5fd-5b80-41e4-9cdf-ae1f4b463073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Volume volume-27397a7f-f581-4329-87d7-b2f429f58d02 (27397a7f-f581-4329-87d7-b2f429f58d02): created successfully
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d053e5fd-5b80-41e4-9cdf-ae1f4b463073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (c0af882e-1064-46c4-b3bb-dbcce03c2eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4c93596e-d3cc-4713-bbc1-cd117ceb4a35 tempest-ProjectReaderTests-182387073 None] Created volume successfully.
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-27397a7f-f581-4329-87d7-b2f429f58d02-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "cinder-27397a7f-f581-4329-87d7-b2f429f58d02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-quobyte-27397a7f-f581-4329-87d7-b2f429f58d02" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:22 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-27397a7f-f581-4329-87d7-b2f429f58d02" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ee0cbd-ba24-4197-80b2-5210796f722a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:23 devstack sudo[106309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02
Sep 04 06:12:23 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:23 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:23 devstack sudo[106315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02
Sep 04 06:12:23 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:23 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-27397a7f-f581-4329-87d7-b2f429f58d02" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-27397a7f-f581-4329-87d7-b2f429f58d02" released by "delete_volume" :: held 0.694s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Created reservations ['3dd24bbd-9e0a-48b6-9118-cfc7b8e5282b', '2d52ac0b-1158-44c7-ad6e-352822518332', 'c3f3ff7a-00ea-488c-b128-200b889fa2ff', '9700d5ec-f61c-4852-a895-2bd6fda76798'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:23 devstack sudo[106318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:23 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:24 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:24 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Deleted volume successfully.
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3d40a6cd-0e51-4221-a9a2-be50b35bc429 tempest-ProjectReaderTests-182387073 None] Lock "cinder-27397a7f-f581-4329-87d7-b2f429f58d02-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (18dd3acc-fae2-4236-b57b-24a1b10a4e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be2f300-c5b6-42ad-ad68-590ae5ace58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be2f300-c5b6-42ad-ad68-590ae5ace58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789430752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adfcf29-1f8c-47be-a0aa-91321678919b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:24Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5ba581-4d8c-4e0f-8275-1ed48ce28453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5ba581-4d8c-4e0f-8275-1ed48ce28453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f07327e-ccb4-4451-b601-af7e412dab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f07327e-ccb4-4451-b601-af7e412dab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adfcf29-1f8c-47be-a0aa-91321678919b', 'volume_name': 'volume-5adfcf29-1f8c-47be-a0aa-91321678919b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a1edfb-4236-413b-b5e0-25e0bd4cc111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12a1edfb-4236-413b-b5e0-25e0bd4cc111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc472bbc-3e40-4b0a-aa2d-02247ced8628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:24 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Volume 5adfcf29-1f8c-47be-a0aa-91321678919b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adfcf29-1f8c-47be-a0aa-91321678919b', 'volume_size': 1}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1789430752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adfcf29-1f8c-47be-a0aa-91321678919b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90ea50145dda46ba823992177f54bb12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:24Z,use_quota=True,user_id='4a186a9d19454a0ca924354ea048c615',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Creating volume 5adfcf29-1f8c-47be-a0aa-91321678919b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:24 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:24 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b 1073741824
Sep 04 06:12:24 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:24 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b 1073741824" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:25 devstack sudo[106328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b
Sep 04 06:12:25 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:25 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b" returned: 0 in 0.226s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc472bbc-3e40-4b0a-aa2d-02247ced8628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adfcf29-1f8c-47be-a0aa-91321678919b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4da76-1cc5-480f-89ca-c5d4b810b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Volume volume-5adfcf29-1f8c-47be-a0aa-91321678919b (5adfcf29-1f8c-47be-a0aa-91321678919b): created successfully
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead4da76-1cc5-480f-89ca-c5d4b810b78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Flow 'volume_create_manager' (18dd3acc-fae2-4236-b57b-24a1b10a4e16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-25c29b0c-b037-41db-aa6e-5b4e640e136b tempest-ProjectReaderTests-182387073 None] Created volume successfully.
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-5adfcf29-1f8c-47be-a0aa-91321678919b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "cinder-5adfcf29-1f8c-47be-a0aa-91321678919b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Acquiring lock "cinder-quobyte-5adfcf29-1f8c-47be-a0aa-91321678919b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-5adfcf29-1f8c-47be-a0aa-91321678919b" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[990a9f7f-c47b-4565-aa0d-28dd04d97f6d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:25 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b
Sep 04 06:12:25 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:25 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:25 devstack sudo[106336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b
Sep 04 06:12:25 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:26 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5adfcf29-1f8c-47be-a0aa-91321678919b" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "cinder-quobyte-5adfcf29-1f8c-47be-a0aa-91321678919b" released by "delete_volume" :: held 0.607s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Created reservations ['e75a836a-dd41-401e-9d8e-f20f24fc8bfb', '1767a4f4-869c-4a5c-a513-509067bc0c94', 'f43c833f-59b9-4960-b1ba-ee7f87c3fcf4', '28d7d900-9fe1-4154-a098-c5e6975e51a4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:26 devstack sudo[106339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:26 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:26 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.232s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Deleted volume successfully.
Sep 04 06:12:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-f3e902d1-78b4-4d79-997a-1cf28b8ced1b tempest-ProjectReaderTests-182387073 None] Lock "cinder-5adfcf29-1f8c-47be-a0aa-91321678919b-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=147,cinder:UPDATE=232,cinder:INSERT=52,cinder:DELETE=21 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:12:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=195,cinder:SELECT=156,cinder:DELETE=17,cinder:INSERT=58 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (fd486722-3d99-4e6d-8938-ddce0f4b6154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5137c7ff-66f0-43dd-af7c-b772bbf698ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5137c7ff-66f0-43dd-af7c-b772bbf698ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374731164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16e970-3dac-4378-b7b0-d65914b537fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:39Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5736b7c-4f2e-4678-be04-a288fc3cccd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5736b7c-4f2e-4678-be04-a288fc3cccd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b5073c-7bde-4135-823b-663d9da11044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b5073c-7bde-4135-823b-663d9da11044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b16e970-3dac-4378-b7b0-d65914b537fb', 'volume_name': 'volume-3b16e970-3dac-4378-b7b0-d65914b537fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b63a82d-cb85-4e1a-b887-e62d005caba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b63a82d-cb85-4e1a-b887-e62d005caba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16d28fb-b1bc-46ad-b905-cb8ce649d293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume 3b16e970-3dac-4378-b7b0-d65914b537fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b16e970-3dac-4378-b7b0-d65914b537fb', 'volume_size': 1}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-374731164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b16e970-3dac-4378-b7b0-d65914b537fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:39Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume 3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:39 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:39 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb 1073741824
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:39 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (b109c06d-276c-4958-bc07-1f3c5cfbe8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bae0b6-8899-4af5-98d9-b50a72f6900e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bae0b6-8899-4af5-98d9-b50a72f6900e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655490415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5373d4e5-507f-4d20-8d3a-5d80921531b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:39Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc703ab5-c156-4bb3-a3b8-c891e15798ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc703ab5-c156-4bb3-a3b8-c891e15798ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5506e0-a493-4b82-85ef-f515a454dcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5506e0-a493-4b82-85ef-f515a454dcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5373d4e5-507f-4d20-8d3a-5d80921531b7', 'volume_name': 'volume-5373d4e5-507f-4d20-8d3a-5d80921531b7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e33aba-2bda-4f4b-9074-be39717eb1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36e33aba-2bda-4f4b-9074-be39717eb1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4b484-70ac-447c-b17c-92aa108bc4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Volume 5373d4e5-507f-4d20-8d3a-5d80921531b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5373d4e5-507f-4d20-8d3a-5d80921531b7', 'volume_size': 1}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (a314aa10-a8ce-4828-97e7-a9635b68da14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9141da70-edd9-4667-9bbb-9046d6ee1b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9141da70-edd9-4667-9bbb-9046d6ee1b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732718099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9a7622-1eb7-4737-9caa-387ee0543c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac3f106-11f4-404f-92d7-953d9f09002c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac3f106-11f4-404f-92d7-953d9f09002c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8375ce3c-bab1-420e-b632-a27c9223e889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8375ce3c-bab1-420e-b632-a27c9223e889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9a7622-1eb7-4737-9caa-387ee0543c98', 'volume_name': 'volume-cb9a7622-1eb7-4737-9caa-387ee0543c98', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efe8cbe-9d3e-4e32-8926-a5de6daf4dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7efe8cbe-9d3e-4e32-8926-a5de6daf4dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073fe218-5087-43b0-8a92-001008ced26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Volume cb9a7622-1eb7-4737-9caa-387ee0543c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9a7622-1eb7-4737-9caa-387ee0543c98', 'volume_size': 1}
Sep 04 06:12:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:40 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb 1073741824" returned: 0 in 0.814s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:40 devstack sudo[106422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb
Sep 04 06:12:40 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (8def8cd3-13d4-4b77-9e42-9bc3e50d173a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb35a4a4-86ce-40cb-b526-f6da9edc6473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb35a4a4-86ce-40cb-b526-f6da9edc6473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329570698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93cf7c4-8c07-4137-9e1e-8ff92ed53518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af0774-92b6-4d82-856d-b915128d5cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af0774-92b6-4d82-856d-b915128d5cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fff927-7bd9-41a6-ac6c-88a48d00646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fff927-7bd9-41a6-ac6c-88a48d00646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c93cf7c4-8c07-4137-9e1e-8ff92ed53518', 'volume_name': 'volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9453e114-afea-465f-8213-ed066a0628cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9453e114-afea-465f-8213-ed066a0628cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da710cdc-0c97-43f4-b517-e09b8241f635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Volume c93cf7c4-8c07-4137-9e1e-8ff92ed53518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518', 'volume_size': 1}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Flow 'volume_create_manager' (0e399744-2c41-4492-a02f-155a1a09848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdb0ddc-8059-44fc-b69a-5a3418cebf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdb0ddc-8059-44fc-b69a-5a3418cebf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580733442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69ccc31-9c2e-4aa7-a5ca-8bd476b05337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2becaec889274feeaa16a7cf79ecd4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='fb6b778ae6854aa3addf6d46125334a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4b9aa2-12c6-48e0-8c3e-9202ed18ecd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd4b9aa2-12c6-48e0-8c3e-9202ed18ecd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb0b88b-2e24-4242-be35-e2ec9c31dfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb0b88b-2e24-4242-be35-e2ec9c31dfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f69ccc31-9c2e-4aa7-a5ca-8bd476b05337', 'volume_name': 'volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b0deb3-940d-4eb3-9598-6a719993fa02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22b0deb3-940d-4eb3-9598-6a719993fa02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9d0ca1-11f4-4f77-97ff-a0cb19f990ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Volume f69ccc31-9c2e-4aa7-a5ca-8bd476b05337: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337', 'volume_size': 1}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-655490415',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5373d4e5-507f-4d20-8d3a-5d80921531b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:39Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Creating volume 5373d4e5-507f-4d20-8d3a-5d80921531b7 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16d28fb-b1bc-46ad-b905-cb8ce649d293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b16e970-3dac-4378-b7b0-d65914b537fb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e897c94-3365-478b-a525-949ced13325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 1073741824
Sep 04 06:12:40 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-3b16e970-3dac-4378-b7b0-d65914b537fb (3b16e970-3dac-4378-b7b0-d65914b537fb): created successfully
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e897c94-3365-478b-a525-949ced13325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (fd486722-3d99-4e6d-8938-ddce0f4b6154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4a9c05dd-a98d-41bc-80a3-70fe37159441 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (9f6567b5-7fc9-4b66-98b8-c74674360d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e2919e-01d4-4f4c-b85a-1a90093ba10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e2919e-01d4-4f4c-b85a-1a90093ba10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-32661609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1624a844-62ff-486e-a251-c5df3b8a8173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:41Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59209b82-5696-435c-85ca-57fb04d01c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59209b82-5696-435c-85ca-57fb04d01c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c827e5d-3764-465f-8578-454d20f90dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c827e5d-3764-465f-8578-454d20f90dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1624a844-62ff-486e-a251-c5df3b8a8173', 'volume_name': 'volume-1624a844-62ff-486e-a251-c5df3b8a8173', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0e8b5-deaa-4a2e-bc77-739f3b7a10c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49c0e8b5-deaa-4a2e-bc77-739f3b7a10c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60b310-6f1c-4451-a6e2-f876196d865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:40 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Volume 1624a844-62ff-486e-a251-c5df3b8a8173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1624a844-62ff-486e-a251-c5df3b8a8173', 'volume_size': 1}
Sep 04 06:12:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (6c56e134-65bb-462f-87fa-523c27f3bbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c957adb6-166a-4ae8-b8c5-dab52ebb28ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c957adb6-166a-4ae8-b8c5-dab52ebb28ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266944134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de458660-c63f-4d2b-a27f-c97af3bce210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:41Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e8268-028d-4622-a34b-fce12e619925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de4e8268-028d-4622-a34b-fce12e619925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae890a21-c066-4600-bc09-b41657ea9f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae890a21-c066-4600-bc09-b41657ea9f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de458660-c63f-4d2b-a27f-c97af3bce210', 'volume_name': 'volume-de458660-c63f-4d2b-a27f-c97af3bce210', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4d4d1c-2109-44d4-9697-ebb166ce0f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb4d4d1c-2109-44d4-9697-ebb166ce0f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9b8317-9d4b-444f-9909-15be716160ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Volume de458660-c63f-4d2b-a27f-c97af3bce210: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de458660-c63f-4d2b-a27f-c97af3bce210', 'volume_size': 1}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 1073741824" returned: 0 in 0.707s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:41 devstack sudo[106432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7
Sep 04 06:12:41 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:41 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.860s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-732718099',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9a7622-1eb7-4737-9caa-387ee0543c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Creating volume cb9a7622-1eb7-4737-9caa-387ee0543c98 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:41 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4b484-70ac-447c-b17c-92aa108bc4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5373d4e5-507f-4d20-8d3a-5d80921531b7', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack sudo[106435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 1073741824
Sep 04 06:12:41 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ab1e9e-a696-4e93-a24c-bd4ba5d58806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:41 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Volume volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 (5373d4e5-507f-4d20-8d3a-5d80921531b7): created successfully
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ab1e9e-a696-4e93-a24c-bd4ba5d58806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:41 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (b109c06d-276c-4958-bc07-1f3c5cfbe8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0baf1a61-87fa-4d18-a6df-d49025c91524 tempest-CreateVolumesFromImageTest-23192975 None] Created volume successfully.
Sep 04 06:12:42 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 1073741824" returned: 0 in 0.497s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:42 devstack sudo[106441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98
Sep 04 06:12:42 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:42 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1329570698',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c93cf7c4-8c07-4137-9e1e-8ff92ed53518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Creating volume c93cf7c4-8c07-4137-9e1e-8ff92ed53518 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (073fe218-5087-43b0-8a92-001008ced26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9a7622-1eb7-4737-9caa-387ee0543c98', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:42 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 1073741824
Sep 04 06:12:42 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962999d1-e262-45e8-b6b5-e9ff1b28649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Volume volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 (cb9a7622-1eb7-4737-9caa-387ee0543c98): created successfully
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962999d1-e262-45e8-b6b5-e9ff1b28649f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (a314aa10-a8ce-4828-97e7-a9635b68da14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ecc6c23a-65ef-43c9-8ace-26ee3abff12d tempest-CreateVolumesFromImageTest-23192975 None] Created volume successfully.
Sep 04 06:12:43 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 1073741824" returned: 0 in 0.490s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:43 devstack sudo[106450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518
Sep 04 06:12:43 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:43 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580733442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f69ccc31-9c2e-4aa7-a5ca-8bd476b05337,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2becaec889274feeaa16a7cf79ecd4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:40Z,use_quota=True,user_id='fb6b778ae6854aa3addf6d46125334a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Creating volume f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da710cdc-0c97-43f4-b517-e09b8241f635) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:43 devstack sudo[106453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 1073741824
Sep 04 06:12:43 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c801b-7266-4358-9669-8a3b903d9fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Volume volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 (c93cf7c4-8c07-4137-9e1e-8ff92ed53518): created successfully
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799c801b-7266-4358-9669-8a3b903d9fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (8def8cd3-13d4-4b77-9e42-9bc3e50d173a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-910202e8-e9bb-48ef-b23a-ab3d73126b7e tempest-CreateVolumesFromImageTest-23192975 None] Created volume successfully.
Sep 04 06:12:43 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 1073741824" returned: 0 in 0.545s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:44 devstack sudo[106459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337
Sep 04 06:12:44 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Flow 'volume_create_manager' (07de6d54-fdff-4073-87d1-425567309bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81eca48-7fd8-4492-929a-11dc6d45a499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81eca48-7fd8-4492-929a-11dc6d45a499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfff538f-985b-4478-9e11-9ae3310d05cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f05cee5a1264e33a02f2b9e2e1f2f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:44Z,use_quota=True,user_id='754ba166e9854194b9f4d0992c672a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1314333a-a30c-47df-936c-901163045646),volume_type_id=1314333a-a30c-47df-936c-901163045646)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2f59bb-c76f-48a2-9924-f9a5c89b83cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f2f59bb-c76f-48a2-9924-f9a5c89b83cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f8c35e-569e-43ed-8660-19e843d4b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:12:44 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.374s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-32661609',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1624a844-62ff-486e-a251-c5df3b8a8173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:41Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Creating volume 1624a844-62ff-486e-a251-c5df3b8a8173 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f9d0ca1-11f4-4f77-97ff-a0cb19f990ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack sudo[106462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 1073741824
Sep 04 06:12:44 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b502df-9afd-45e1-837f-923842be89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Volume volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 (f69ccc31-9c2e-4aa7-a5ca-8bd476b05337): created successfully
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b502df-9afd-45e1-837f-923842be89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Flow 'volume_create_manager' (0e399744-2c41-4492-a02f-155a1a09848a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-748ec16d-077d-4f50-8ada-cafa79ddc0eb tempest-ProjectReaderTests-812292064 None] Created volume successfully.
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83f8c35e-569e-43ed-8660-19e843d4b454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dfff538f-985b-4478-9e11-9ae3310d05cf', 'volume_name': 'volume-dfff538f-985b-4478-9e11-9ae3310d05cf', 'volume_size': 1, 'image_id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a6819d66660ccc74a6825055728883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f05cee5a1264e33a02f2b9e2e1f2f7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '096bebf1cc14412d1a73303225bae93f296574b2136185c7f381f43827adcad828f1b660770cd81b0dee3f8d0e5ebcccc37a5a749e3982b1099a43195ac1bd95', 'id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'created_at': datetime.datetime(2026, 9, 4, 4, 12, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 12, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66f05032-b225-4bc1-b554-8a1de36e739f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028904440>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fa5ae2-807d-4326-a708-a14833fb7c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fa5ae2-807d-4326-a708-a14833fb7c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2164c89-57ac-476b-a63e-b6581cf29452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Volume dfff538f-985b-4478-9e11-9ae3310d05cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dfff538f-985b-4478-9e11-9ae3310d05cf', 'volume_size': 1, 'image_id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a6819d66660ccc74a6825055728883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f05cee5a1264e33a02f2b9e2e1f2f7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '096bebf1cc14412d1a73303225bae93f296574b2136185c7f381f43827adcad828f1b660770cd81b0dee3f8d0e5ebcccc37a5a749e3982b1099a43195ac1bd95', 'id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'created_at': datetime.datetime(2026, 9, 4, 4, 12, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 12, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66f05032-b225-4bc1-b554-8a1de36e739f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028904440>}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Trying to clone dfff538f-985b-4478-9e11-9ae3310d05cf from image 66f05032-b225-4bc1-b554-8a1de36e739f at location (None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:12:44 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b16610-b5e9-42e5-b37a-632a3d5e3be2]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:44 devstack sudo[106467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:44 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Acquiring lock "cinder-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:44 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 1073741824" returned: 0 in 0.570s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "cinder-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Acquiring lock "cinder-quobyte-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "cinder-quobyte-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:45 devstack sudo[106470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173
Sep 04 06:12:45 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f9589-b46c-4786-ac49-541ff5a38370]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack sudo[106474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337
Sep 04 06:12:45 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack sudo[106475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:45 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.879s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1266944134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de458660-c63f-4d2b-a27f-c97af3bce210,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c1c9f07e86644b28b69516a52fa3a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:41Z,use_quota=True,user_id='7f9468259287418c8a8c33eee19595bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Creating volume de458660-c63f-4d2b-a27f-c97af3bce210 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:45 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c60b310-6f1c-4451-a6e2-f876196d865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1624a844-62ff-486e-a251-c5df3b8a8173', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b60992e-6a69-4e56-91d6-cc23b1084171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:45 devstack sudo[106479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 1073741824
Sep 04 06:12:45 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Volume volume-1624a844-62ff-486e-a251-c5df3b8a8173 (1624a844-62ff-486e-a251-c5df3b8a8173): created successfully
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b60992e-6a69-4e56-91d6-cc23b1084171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (9f6567b5-7fc9-4b66-98b8-c74674360d2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3eb60f08-a702-46f4-a725-760729c6b899 tempest-CreateVolumesFromImageTest-23192975 None] Created volume successfully.
Sep 04 06:12:45 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 1 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Temporary image 66f05032-b225-4bc1-b554-8a1de36e739f is fetched for user 754ba166e9854194b9f4d0992c672a1c. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337
Sep 04 06:12:45 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[730b298e-d36a-4232-bf33-5b9d7293bbcc]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:45 devstack sudo[106490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:45 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:45 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "cinder-quobyte-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337" released by "delete_volume" :: held 0.823s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Created reservations ['cbdbabcc-0e9e-4a0c-84f6-1c5dbcfb5167', 'd7348f45-f4fb-484b-80bb-880c4ddc3c81', '804be1a0-e653-4a42-bb96-e3f493b581e7', '2046184d-6dea-4b86-a56d-b551e3aef90f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:45 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 1073741824" returned: 0 in 0.631s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:46 devstack sudo[106500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210
Sep 04 06:12:46 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:46 devstack sudo[106502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:46 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:46 devstack sudo[106499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:46 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:46 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.814s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:46 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:46 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 1 in 0.451s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.378s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9b8317-9d4b-444f-9909-15be716160ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de458660-c63f-4d2b-a27f-c97af3bce210', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb4062d-5b17-49c9-baa1-aecadaf7c6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Deleted volume successfully.
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating offline snapshot 71926df5-5cbd-4275-b88c-acee772fd2fa of volume 3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:12:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Volume volume-de458660-c63f-4d2b-a27f-c97af3bce210 (de458660-c63f-4d2b-a27f-c97af3bce210): created successfully
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb4062d-5b17-49c9-baa1-aecadaf7c6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Flow 'volume_create_manager' (6c56e134-65bb-462f-87fa-523c27f3bbe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[442ff2ca-bf2c-41d6-9267-4d74a062ccb8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-70d92b61-9d17-4fe8-a7be-6a066a128986 tempest-ProjectReaderTests-812292064 None] Lock "cinder-f69ccc31-9c2e-4aa7-a5ca-8bd476b05337-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0837f20c-48a8-43c4-b86a-49f039760ea9 tempest-CreateVolumesFromImageTest-23192975 None] Created volume successfully.
Sep 04 06:12:46 devstack sudo[106510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb
Sep 04 06:12:46 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Flow 'volume_create_manager' (5b2b1816-fc10-4e8e-b3e4-b40425cf29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1add1c69-ecd5-433d-82ec-3252a0a0193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1add1c69-ecd5-433d-82ec-3252a0a0193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830028327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47050a77-9d12-47db-934f-70d2a88e379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2becaec889274feeaa16a7cf79ecd4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:47Z,use_quota=True,user_id='fb6b778ae6854aa3addf6d46125334a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec8134-d7e1-4655-97d8-a955fc445cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec8134-d7e1-4655-97d8-a955fc445cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125e26b0-fb8d-4a49-ba89-53dcea463031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (125e26b0-fb8d-4a49-ba89-53dcea463031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47050a77-9d12-47db-934f-70d2a88e379a', 'volume_name': 'volume-47050a77-9d12-47db-934f-70d2a88e379a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4072e65-4995-449b-8a69-979cdb0f1245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4072e65-4995-449b-8a69-979cdb0f1245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239a256c-d6f5-4023-8391-f38e66343ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:46 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Volume 47050a77-9d12-47db-934f-70d2a88e379a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47050a77-9d12-47db-934f-70d2a88e379a', 'volume_size': 1}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-de458660-c63f-4d2b-a27f-c97af3bce210-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-de458660-c63f-4d2b-a27f-c97af3bce210-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:46 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:46 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa 1G
Sep 04 06:12:46 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-quobyte-de458660-c63f-4d2b-a27f-c97af3bce210" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-de458660-c63f-4d2b-a27f-c97af3bce210" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c544cb-4753-44f7-8ee5-45592372f74d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:47 devstack sudo[106518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210
Sep 04 06:12:47 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:47 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa 1G" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b16e970-3dac-4378-b7b0-d65914b537fb -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:47 devstack sudo[106526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b16e970-3dac-4378-b7b0-d65914b537fb -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa
Sep 04 06:12:47 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:47 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210" returned: 0 in 0.411s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:47 devstack sudo[106528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210
Sep 04 06:12:47 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:47 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-de458660-c63f-4d2b-a27f-c97af3bce210" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:47 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b16e970-3dac-4378-b7b0-d65914b537fb -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa" returned: 0 in 0.312s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa is being set with open permissions: ugo+rw
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-de458660-c63f-4d2b-a27f-c97af3bce210" released by "delete_volume" :: held 0.736s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:47 devstack sudo[106534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa
Sep 04 06:12:47 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Created reservations ['662f2da3-ad67-4b38-860f-9de966f42c4d', 'c8f5b319-b831-4a2c-93cc-5c8536537745', 'fa279734-d8c7-444c-8163-f4358ac5b53f', '1fdd9f41-e48f-49cf-a4b4-1d3aa9ef26a9'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:47 devstack sudo[106542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:48 devstack sudo[106545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info
Sep 04 06:12:48 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-1624a844-62ff-486e-a251-c5df3b8a8173-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-1624a844-62ff-486e-a251-c5df3b8a8173-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:48 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-quobyte-1624a844-62ff-486e-a251-c5df3b8a8173" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Deleted volume successfully.
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-1624a844-62ff-486e-a251-c5df3b8a8173" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b438cc2-1894-4896-bee4-90678f7fdc64]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-eba93c1a-8ad2-43c6-b9a9-9410f14c5f7c tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-de458660-c63f-4d2b-a27f-c97af3bce210-delete_volume" released by "delete_volume" :: held 1.322s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:48 devstack sudo[106548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173
Sep 04 06:12:48 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:48 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info is being set with open permissions: ugo+rw
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:48 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info
Sep 04 06:12:48 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.info" returned: 0 in 0.267s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:48 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:48 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.273s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.260s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfff538f-985b-4478-9e11-9ae3310d05cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f05cee5a1264e33a02f2b9e2e1f2f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:44Z,use_quota=True,user_id='754ba166e9854194b9f4d0992c672a1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1314333a-a30c-47df-936c-901163045646),volume_type_id=1314333a-a30c-47df-936c-901163045646)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Creating volume dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173" returned: 0 in 0.479s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:48 devstack sudo[106557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1073741824
Sep 04 06:12:48 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack sudo[106558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173
Sep 04 06:12:48 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-daeb0b5c-92e1-42dd-a07d-80575672b770 tempest-CreateVolumesFromSnapshotTest-202810352 None] Create snapshot completed successfully
Sep 04 06:12:49 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1624a844-62ff-486e-a251-c5df3b8a8173" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-1624a844-62ff-486e-a251-c5df3b8a8173" released by "delete_volume" :: held 0.816s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Created reservations ['9c3fd421-4b88-48f7-aac3-73a6e56182f9', 'b18613e8-9443-49c6-ada8-d1c6dceda402', 'e90b09df-0fff-4b5b-97e6-550e08bb7595', '8e756bb3-8bc6-44b7-991e-58a70b5579ba'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:49 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1073741824" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:49 devstack sudo[106566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:49 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-c93cf7c4-8c07-4137-9e1e-8ff92ed53518-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-c93cf7c4-8c07-4137-9e1e-8ff92ed53518-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:49 devstack sudo[106568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf
Sep 04 06:12:49 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:49 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (47076c4b-5e46-495e-8544-2e3892cf663c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b75879-694c-4511-8bc5-8316b205493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-quobyte-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Deleted volume successfully.
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15b75879-694c-4511-8bc5-8316b205493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861089036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393c5364-8aaa-4d6f-8186-922768e369be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:50Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d64685a-5a11-47c6-b831-90ef3fdfb828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d64685a-5a11-47c6-b831-90ef3fdfb828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b0cde6-b361-49cd-8822-722a1d87d731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b0cde6-b361-49cd-8822-722a1d87d731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '393c5364-8aaa-4d6f-8186-922768e369be', 'volume_name': 'volume-393c5364-8aaa-4d6f-8186-922768e369be', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dec55fa-f3b3-4228-b371-a2746eaa6fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dec55fa-f3b3-4228-b371-a2746eaa6fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9290acf3-510c-4283-8688-6fa1d6da3e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume 393c5364-8aaa-4d6f-8186-922768e369be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-393c5364-8aaa-4d6f-8186-922768e369be', 'volume_size': 1}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" acquired by "delete_volume" :: waited 0.089s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edaec270-af22-40c4-b876-f43f18e7a3ac tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-1624a844-62ff-486e-a251-c5df3b8a8173-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8645e24-4e19-4742-9817-32a791724834]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:49 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.123s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1830028327',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47050a77-9d12-47db-934f-70d2a88e379a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2becaec889274feeaa16a7cf79ecd4ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:47Z,use_quota=True,user_id='fb6b778ae6854aa3addf6d46125334a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Creating volume 47050a77-9d12-47db-934f-70d2a88e379a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:49 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:49 devstack sudo[106573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a 1073741824
Sep 04 06:12:49 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Attempting download of 66f05032-b225-4bc1-b554-8a1de36e739f ((None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}])) to volume dfff538f-985b-4478-9e11-9ae3310d05cf. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:12:50 devstack sudo[106571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518
Sep 04 06:12:50 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9755d209-29dd-4de0-8131-068308f6b998]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (f9e92a88-449f-4442-91f0-425d03b8f3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73598ad-ce7c-45d1-9787-fb038e7168ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b73598ad-ce7c-45d1-9787-fb038e7168ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796143423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab7b16c-e153-4c7a-96d7-12d18458031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:50Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae823cd-a843-4268-84b1-4400a4f5b92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ae823cd-a843-4268-84b1-4400a4f5b92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3215eb-1fc7-44d4-8314-7d6c031d483c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3215eb-1fc7-44d4-8314-7d6c031d483c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab7b16c-e153-4c7a-96d7-12d18458031b', 'volume_name': 'volume-0ab7b16c-e153-4c7a-96d7-12d18458031b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c4475-6dbc-4282-ac64-fa087889b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c4475-6dbc-4282-ac64-fa087889b115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471d89bf-fbe5-4e76-9ad9-98a7adc9ae11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume 0ab7b16c-e153-4c7a-96d7-12d18458031b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab7b16c-e153-4c7a-96d7-12d18458031b', 'volume_size': 1}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:50 devstack sudo[106576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f
Sep 04 06:12:50 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" returned: 0 in 0.632s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:50 devstack sudo[106587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518
Sep 04 06:12:50 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f" returned: 0 in 0.530s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:50 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a 1073741824" returned: 0 in 0.792s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:50 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:50 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f
Sep 04 06:12:50 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack sudo[106593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a
Sep 04 06:12:50 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (599c665a-db5e-41d2-8e97-7fa7ec457889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd93e18-93b0-4d84-84f8-78d6aa8699a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd93e18-93b0-4d84-84f8-78d6aa8699a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593638097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ccd636-ca31-46eb-9ac4-66387a005386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:51Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6630d1-0f62-4659-9539-1ad505c8222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6630d1-0f62-4659-9539-1ad505c8222b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ed940d-3fb8-4bb7-884f-1612b9ae6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ed940d-3fb8-4bb7-884f-1612b9ae6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ccd636-ca31-46eb-9ac4-66387a005386', 'volume_name': 'volume-73ccd636-ca31-46eb-9ac4-66387a005386', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8162114d-daf4-430f-859a-a2615c49632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:50 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8162114d-daf4-430f-859a-a2615c49632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7abdfd-b4b1-4372-a881-ea1cbdf02abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume 73ccd636-ca31-46eb-9ac4-66387a005386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ccd636-ca31-46eb-9ac4-66387a005386', 'volume_size': 1}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-c93cf7c4-8c07-4137-9e1e-8ff92ed53518" released by "delete_volume" :: held 1.247s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Created reservations ['6c84d3c5-ee71-456f-8b92-edec0c2c5d0d', '8585770e-df1a-4061-a0ca-666e208cd357', '58a6af96-2af5-4c74-99ed-e1dcd92d8cac', '0e99cd6a-ecd2-4ff6-9576-a82305d9ff54'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:51 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f" returned: 1 in 0.486s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_66f05032-b225-4bc1-b554-8a1de36e739f_euv0xx3f' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf1782c-3ee1-4b89-8333-f27e77fbddb0]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:51 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a" returned: 0 in 0.466s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:51 devstack sudo[106601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:51 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.550s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861089036',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=393c5364-8aaa-4d6f-8186-922768e369be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:50Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume 393c5364-8aaa-4d6f-8186-922768e369be {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:51 devstack sudo[106600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:51 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:51 devstack sudo[106603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be 1073741824
Sep 04 06:12:51 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239a256c-d6f5-4023-8391-f38e66343ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47050a77-9d12-47db-934f-70d2a88e379a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc4f5dc-408b-4b95-b94d-3cff3b4a369e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Volume volume-47050a77-9d12-47db-934f-70d2a88e379a (47050a77-9d12-47db-934f-70d2a88e379a): created successfully
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cc4f5dc-408b-4b95-b94d-3cff3b4a369e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Flow 'volume_create_manager' (5b2b1816-fc10-4e8e-b3e4-b40425cf29fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (81c63826-6ac8-4d23-af8d-fbd44733ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5358b9b2-acd5-4f49-873f-99e880cc4da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-df7b9a36-c6b9-420f-a3d6-2e19a9ca1b35 tempest-ProjectReaderTests-812292064 None] Created volume successfully.
Sep 04 06:12:51 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.456s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5358b9b2-acd5-4f49-873f-99e880cc4da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303711007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59bdeb7-9204-42c2-9325-be691adb1811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:51Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e74db-5923-4cb9-9e9f-c657b51ebf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476e74db-5923-4cb9-9e9f-c657b51ebf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f80ae0-e8fd-4084-ac9f-f9cf35314d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f80ae0-e8fd-4084-ac9f-f9cf35314d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b59bdeb7-9204-42c2-9325-be691adb1811', 'volume_name': 'volume-b59bdeb7-9204-42c2-9325-be691adb1811', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8e92d1-a505-48f4-bbc6-32fb0c490490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8e92d1-a505-48f4-bbc6-32fb0c490490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cea6326-487e-4c04-8759-5f3b2bf36902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume b59bdeb7-9204-42c2-9325-be691adb1811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b59bdeb7-9204-42c2-9325-be691adb1811', 'volume_size': 1}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Deleted volume successfully.
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-cb9a7622-1eb7-4737-9caa-387ee0543c98-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 0 in 0.692s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1b50ec66-1dab-4833-ac38-042dd8ecc4ef tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-c93cf7c4-8c07-4137-9e1e-8ff92ed53518-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-cb9a7622-1eb7-4737-9caa-387ee0543c98-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-quobyte-cb9a7622-1eb7-4737-9caa-387ee0543c98" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-cb9a7622-1eb7-4737-9caa-387ee0543c98" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ba15d5-d55a-4ee7-987e-d962cf8242f7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack sudo[106612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD
Sep 04 06:12:52 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be 1073741824" returned: 0 in 0.741s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (14874709-d2de-4c68-ad54-db326d8fbe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2e6fbc-b89d-403c-8757-8e1fafdc3ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f2e6fbc-b89d-403c-8757-8e1fafdc3ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968343107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4663fc-6439-4e2c-b491-ee0a43a0f8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:52Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d7f4ac-b647-40d7-aad3-1fb33c1a8c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d7f4ac-b647-40d7-aad3-1fb33c1a8c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792262d6-d485-44bf-a1c3-6edba4269ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792262d6-d485-44bf-a1c3-6edba4269ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4663fc-6439-4e2c-b491-ee0a43a0f8b9', 'volume_name': 'volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f896fb-417a-4f9a-bfb8-9d3aa1365f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73f896fb-417a-4f9a-bfb8-9d3aa1365f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack sudo[106614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98
Sep 04 06:12:52 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c57ea0c-dcdb-4ad8-8a1f-22ba292cd559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume 1a4663fc-6439-4e2c-b491-ee0a43a0f8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9', 'volume_size': 1}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Acquiring lock "cinder-47050a77-9d12-47db-934f-70d2a88e379a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "cinder-47050a77-9d12-47db-934f-70d2a88e379a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:52 devstack sudo[106616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be
Sep 04 06:12:52 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Acquiring lock "cinder-quobyte-47050a77-9d12-47db-934f-70d2a88e379a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "cinder-quobyte-47050a77-9d12-47db-934f-70d2a88e379a" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b2520-0414-4885-9b43-d523cedb83da]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD" returned: 1 in 0.564s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] 66f05032-b225-4bc1-b554-8a1de36e739f was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack sudo[106622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf
Sep 04 06:12:52 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98" returned: 0 in 0.480s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack sudo[106621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a
Sep 04 06:12:52 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98
Sep 04 06:12:52 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be" returned: 0 in 0.374s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.302s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1796143423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab7b16c-e153-4c7a-96d7-12d18458031b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:50Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume 0ab7b16c-e153-4c7a-96d7-12d18458031b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:52 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9290acf3-510c-4283-8688-6fa1d6da3e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-393c5364-8aaa-4d6f-8186-922768e369be', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack sudo[106631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b 1073741824
Sep 04 06:12:52 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55efe9dd-5b81-4fa4-b327-f4f0641b429e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-393c5364-8aaa-4d6f-8186-922768e369be (393c5364-8aaa-4d6f-8186-922768e369be): created successfully
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55efe9dd-5b81-4fa4-b327-f4f0641b429e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (47076c4b-5e46-495e-8544-2e3892cf663c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9d93466c-157e-4ba9-b7c8-240a44b0a538 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:52 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a" returned: 0 in 0.447s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:52 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-cb9a7622-1eb7-4737-9caa-387ee0543c98" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:52 devstack sudo[106641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a
Sep 04 06:12:52 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-cb9a7622-1eb7-4737-9caa-387ee0543c98" released by "delete_volume" :: held 0.887s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:52 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Created reservations ['237951d1-5363-49c0-a887-8e874a8121e3', 'ad2a68df-46e3-4708-87a1-ee9cf64964fd', 'f550e5fa-cd16-47ea-a806-c8d62724e4b4', 'd3e30676-3318-4897-a309-8b2b96967afd'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf" returned: 0 in 0.650s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_66f05032-b225-4bc1-b554-8a1de36e739f_vf44s0cxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:53 devstack sudo[106646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1G
Sep 04 06:12:53 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:53 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:53 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:53 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-47050a77-9d12-47db-934f-70d2a88e379a" returned: 0 in 0.397s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "cinder-quobyte-47050a77-9d12-47db-934f-70d2a88e379a" released by "delete_volume" :: held 0.909s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:53 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b 1073741824" returned: 0 in 0.650s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Created reservations ['7d273956-a7f7-4aa4-be8b-784e1dc541b8', 'f43ac4d9-d070-44cf-aba9-3099fbaaea77', '495e9e05-4a51-40af-9a6d-1bee712bab0c', '554e9e81-6477-472c-85f2-804e89a8f198'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:53 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b
Sep 04 06:12:53 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:53 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:53 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf 1G" returned: 0 in 0.431s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Downloaded image 66f05032-b225-4bc1-b554-8a1de36e739f ((None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}])) to volume dfff538f-985b-4478-9e11-9ae3310d05cf successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Temporary image 66f05032-b225-4bc1-b554-8a1de36e739f for user 754ba166e9854194b9f4d0992c672a1c is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Marking volume dfff538f-985b-4478-9e11-9ae3310d05cf as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Deleted volume successfully.
Sep 04 06:12:53 devstack sudo[106659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:53 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Copying metadata from image 66f05032-b225-4bc1-b554-8a1de36e739f to dfff538f-985b-4478-9e11-9ae3310d05cf. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Creating volume glance metadata for volume dfff538f-985b-4478-9e11-9ae3310d05cf backed by image 66f05032-b225-4bc1-b554-8a1de36e739f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd2a6819d66660ccc74a6825055728883', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e260174-fb54-45e5-890f-f722aa9ca126 tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-cb9a7622-1eb7-4737-9caa-387ee0543c98-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2164c89-57ac-476b-a63e-b6581cf29452) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfff538f-985b-4478-9e11-9ae3310d05cf', 'volume_size': 1, 'image_id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/66f05032-b225-4bc1-b554-8a1de36e739f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd2a6819d66660ccc74a6825055728883', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1f05cee5a1264e33a02f2b9e2e1f2f7e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '096bebf1cc14412d1a73303225bae93f296574b2136185c7f381f43827adcad828f1b660770cd81b0dee3f8d0e5ebcccc37a5a749e3982b1099a43195ac1bd95', 'id': '66f05032-b225-4bc1-b554-8a1de36e739f', 'created_at': datetime.datetime(2026, 9, 4, 4, 12, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 12, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/66f05032-b225-4bc1-b554-8a1de36e739f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x732028904440>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1578db21-0cdb-48f1-9031-90557daa1fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Volume volume-dfff538f-985b-4478-9e11-9ae3310d05cf (dfff538f-985b-4478-9e11-9ae3310d05cf): created successfully
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1578db21-0cdb-48f1-9031-90557daa1fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Flow 'volume_create_manager' (07de6d54-fdff-4073-87d1-425567309bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:53 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5e64dbc0-ee9c-4aa5-973e-3b260adcce89 tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Created volume successfully.
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b" returned: 0 in 0.311s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.671s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1593638097',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ccd636-ca31-46eb-9ac4-66387a005386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:51Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume 73ccd636-ca31-46eb-9ac4-66387a005386 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (471d89bf-fbe5-4e76-9ad9-98a7adc9ae11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab7b16c-e153-4c7a-96d7-12d18458031b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:53 devstack sudo[106662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 1073741824
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db544fd6-4a7a-48c9-bf0f-316e8488c48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:53 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-0ab7b16c-e153-4c7a-96d7-12d18458031b (0ab7b16c-e153-4c7a-96d7-12d18458031b): created successfully
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db544fd6-4a7a-48c9-bf0f-316e8488c48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (f9e92a88-449f-4442-91f0-425d03b8f3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:53 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8a73dc5b-69e1-42f9-89a9-316e5a8efdb1 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Deleted volume successfully.
Sep 04 06:12:53 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-31cb8347-e89a-443e-ab19-a8934634af4b tempest-ProjectReaderTests-812292064 None] Lock "cinder-47050a77-9d12-47db-934f-70d2a88e379a-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-5373d4e5-507f-4d20-8d3a-5d80921531b7-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Acquiring lock "cinder-dfff538f-985b-4478-9e11-9ae3310d05cf-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "cinder-dfff538f-985b-4478-9e11-9ae3310d05cf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-5373d4e5-507f-4d20-8d3a-5d80921531b7-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Acquiring lock "cinder-quobyte-dfff538f-985b-4478-9e11-9ae3310d05cf" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "cinder-quobyte-dfff538f-985b-4478-9e11-9ae3310d05cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:54 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "cinder-quobyte-5373d4e5-507f-4d20-8d3a-5d80921531b7" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 1073741824" returned: 0 in 0.566s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b9519-9c79-4860-904d-7ae5a3687fd2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-5373d4e5-507f-4d20-8d3a-5d80921531b7" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[09526863-3629-469f-aed1-7b3ba1b69d71]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack sudo[106671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386
Sep 04 06:12:54 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:54 devstack sudo[106670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7
Sep 04 06:12:54 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:54 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf
Sep 04 06:12:54 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:54 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.869s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-303711007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b59bdeb7-9204-42c2-9325-be691adb1811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:51Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume b59bdeb7-9204-42c2-9325-be691adb1811 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:54 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack sudo[106676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 1073741824
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec7abdfd-b4b1-4372-a881-ea1cbdf02abd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ccd636-ca31-46eb-9ac4-66387a005386', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:54 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5945572-9130-456e-aff7-b70af307f276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-73ccd636-ca31-46eb-9ac4-66387a005386 (73ccd636-ca31-46eb-9ac4-66387a005386): created successfully
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5945572-9130-456e-aff7-b70af307f276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (599c665a-db5e-41d2-8e97-7fa7ec457889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-12e82fe4-b39a-4267-9d39-a4f9225b0de0 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:54 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7" returned: 0 in 0.534s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf" returned: 0 in 0.574s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:54 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7
Sep 04 06:12:54 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:54 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf
Sep 04 06:12:54 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:55 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5373d4e5-507f-4d20-8d3a-5d80921531b7" returned: 0 in 0.338s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-quobyte-5373d4e5-507f-4d20-8d3a-5d80921531b7" released by "delete_volume" :: held 0.945s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:55 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-dfff538f-985b-4478-9e11-9ae3310d05cf" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "cinder-quobyte-dfff538f-985b-4478-9e11-9ae3310d05cf" released by "delete_volume" :: held 1.022s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:55 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 1073741824" returned: 0 in 0.608s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Created reservations ['bc2d724b-44bb-4ed0-bd50-82c6e7a64496', 'd39c9838-62a4-457e-b709-16a1fc3b26eb', '7f7a1838-1d44-4c75-913d-ecaac70420e5', 'e47d187c-bf6b-4b1a-ab63-eda7e370f5bb'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Created reservations ['ea26585f-0954-4897-a74e-25b248a3dc67', '4929a574-7151-4108-9366-07fe87be22f6', '1705ecda-d597-4b5a-9a66-a2d6e5f89eeb', '6d2e536b-9de9-4d5d-9d3e-ec3b80e73aa2'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:55 devstack sudo[106695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811
Sep 04 06:12:55 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:55 devstack sudo[106697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:55 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:55 devstack sudo[106699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:55 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:55 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811" returned: 0 in 0.341s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.527s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968343107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4663fc-6439-4e2c-b491-ee0a43a0f8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f36c2881aac4161898b283422610c37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:12:52Z,use_quota=True,user_id='27ee73f6e3c14d469ac7e9ac43737340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Creating volume 1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:12:55 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cea6326-487e-4c04-8759-5f3b2bf36902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b59bdeb7-9204-42c2-9325-be691adb1811', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:55 devstack sudo[106702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 1073741824
Sep 04 06:12:55 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6e0183-d2bd-4607-a8e1-d93970016eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-b59bdeb7-9204-42c2-9325-be691adb1811 (b59bdeb7-9204-42c2-9325-be691adb1811): created successfully
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6e0183-d2bd-4607-a8e1-d93970016eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:55 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (81c63826-6ac8-4d23-af8d-fbd44733ce50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Deleted volume successfully.
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-256ff9e5-786d-4058-8a72-4c36b134de56 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Deleted volume successfully.
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b05371af-3e28-43e3-903a-2d65fa3a2aae tempest-VolumeAndVolumeTypeFromImageTest-1897634862 None] Lock "cinder-dfff538f-985b-4478-9e11-9ae3310d05cf-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-90f645d8-8ca4-45fb-a65f-dbad84f8fd3a tempest-CreateVolumesFromImageTest-23192975 None] Lock "cinder-5373d4e5-507f-4d20-8d3a-5d80921531b7-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:56 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 1073741824" returned: 0 in 0.531s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:56 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9
Sep 04 06:12:56 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:56 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" returned: 0 in 0.391s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c57ea0c-dcdb-4ad8-8a1f-22ba292cd559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a420e0-b7ea-462d-8e7e-9646820ad45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:12:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Volume volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 (1a4663fc-6439-4e2c-b491-ee0a43a0f8b9): created successfully
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6a420e0-b7ea-462d-8e7e-9646820ad45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:12:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Flow 'volume_create_manager' (14874709-d2de-4c68-ad54-db326d8fbe69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:12:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-84fb6f93-c8f3-440c-b4fc-328dc4d4476b tempest-CreateVolumesFromSnapshotTest-202810352 None] Created volume successfully.
Sep 04 06:12:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89951c3-e3a0-45d9-afeb-d4385497a0db]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:58 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9
Sep 04 06:12:58 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:58 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" returned: 0 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:58 devstack sudo[106718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9
Sep 04 06:12:58 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:58 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9" released by "delete_volume" :: held 0.935s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['8621bcea-475f-4a2c-9197-398cd2e42cc3', '5a235752-1ba6-45ee-8d8c-15032290ddc9', 'a9f3abb2-bac2-4cf9-ad3e-817511c00fd6', '4f250a1f-796f-4280-abe3-f6c4c48a0e85'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:12:59 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:12:59 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:12:59 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:12:59 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:12:59 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b62a18b4-d39e-401b-903d-b318a9236557 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-1a4663fc-6439-4e2c-b491-ee0a43a0f8b9-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-b59bdeb7-9204-42c2-9325-be691adb1811-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-b59bdeb7-9204-42c2-9325-be691adb1811-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (902d71cc-792d-47aa-abbc-f1ba4e7ace0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a619280e-cfb2-4fab-af80-80a5d04fb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-b59bdeb7-9204-42c2-9325-be691adb1811" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a619280e-cfb2-4fab-af80-80a5d04fb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509320266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ded3e5-2ed1-4d1b-8a6d-a1451b532414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:00Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347f330d-8dee-4ff9-a5d4-fdf92ae8b93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (347f330d-8dee-4ff9-a5d4-fdf92ae8b93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188ccc63-7855-4fb9-8e93-c23fa0b359e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188ccc63-7855-4fb9-8e93-c23fa0b359e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96ded3e5-2ed1-4d1b-8a6d-a1451b532414', 'volume_name': 'volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c4483a-8d33-4a1d-a072-a72c3c88fbe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c4483a-8d33-4a1d-a072-a72c3c88fbe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59544446-87f4-41ec-8c2e-0af60f74684c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:00 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 96ded3e5-2ed1-4d1b-8a6d-a1451b532414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414', 'volume_size': 1}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1509320266',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96ded3e5-2ed1-4d1b-8a6d-a1451b532414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:00Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 96ded3e5-2ed1-4d1b-8a6d-a1451b532414 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:00 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-b59bdeb7-9204-42c2-9325-be691adb1811" acquired by "delete_volume" :: waited 0.088s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:00 devstack sudo[106724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 1073741824
Sep 04 06:13:00 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e21ff-21ca-4652-9796-175a2de66ddb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:00 devstack sudo[106726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811
Sep 04 06:13:00 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:01 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 1073741824" returned: 0 in 0.509s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:01 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811" returned: 0 in 0.459s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:01 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811
Sep 04 06:13:01 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:01 devstack sudo[106738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414
Sep 04 06:13:01 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:01 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b59bdeb7-9204-42c2-9325-be691adb1811" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-b59bdeb7-9204-42c2-9325-be691adb1811" released by "delete_volume" :: held 0.856s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:01 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['a56e82a5-5be2-4235-ae59-3bbd33deaa79', '7d6df76c-6d7e-47d5-9cdd-6e02d90b7ad0', '84de702c-b1e6-494f-9ffb-d6ae266022fa', '2323f394-3937-4469-b84d-40bd55bfccec'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59544446-87f4-41ec-8c2e-0af60f74684c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4015e1-720b-406e-897f-cc5980b63a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 (96ded3e5-2ed1-4d1b-8a6d-a1451b532414): created successfully
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f4015e1-720b-406e-897f-cc5980b63a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (902d71cc-792d-47aa-abbc-f1ba4e7ace0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a2393dff-2f56-42c8-a352-54ae2e76b1ae tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:01 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:01 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:01 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:13:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-193c260f-0f53-4a5d-ba92-83fb84abdc33 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-b59bdeb7-9204-42c2-9325-be691adb1811-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-73ccd636-ca31-46eb-9ac4-66387a005386-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-73ccd636-ca31-46eb-9ac4-66387a005386-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-73ccd636-ca31-46eb-9ac4-66387a005386" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-73ccd636-ca31-46eb-9ac4-66387a005386" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[390fa95d-6dbb-448e-b907-27a0c0b36f3a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:03 devstack sudo[106745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386
Sep 04 06:13:03 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (1f43294b-f00e-411b-86a7-ca8e94f744af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401c3bd-dde4-464f-9f90-58185b1f18c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e401c3bd-dde4-464f-9f90-58185b1f18c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233053255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314edba3-375d-42cb-bb48-692d708b4ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:03Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a47387-bb63-4de6-8733-62211576c4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a47387-bb63-4de6-8733-62211576c4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbe51d3-a5fb-4dfe-b260-6a9014af096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fbe51d3-a5fb-4dfe-b260-6a9014af096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314edba3-375d-42cb-bb48-692d708b4ddb', 'volume_name': 'volume-314edba3-375d-42cb-bb48-692d708b4ddb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664091f2-5c3c-4056-b7e4-d2390118d1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (664091f2-5c3c-4056-b7e4-d2390118d1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09787aca-0792-4a0c-905b-d414ea888221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 314edba3-375d-42cb-bb48-692d708b4ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314edba3-375d-42cb-bb48-692d708b4ddb', 'volume_size': 1}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-233053255',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314edba3-375d-42cb-bb48-692d708b4ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:03Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 314edba3-375d-42cb-bb48-692d708b4ddb {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:03 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:03 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb 1073741824
Sep 04 06:13:03 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:03 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386" returned: 0 in 0.527s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:03 devstack sudo[106753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386
Sep 04 06:13:03 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (0e9cf095-03e9-4382-9f62-a899248aa22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de688bd-a10e-425f-a9af-36701f6ddae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de688bd-a10e-425f-a9af-36701f6ddae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065477133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa487fc-f8fa-421f-a575-127f45d8b7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:04Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb89b8d1-e5e7-44ba-a5fe-5528db67e8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb89b8d1-e5e7-44ba-a5fe-5528db67e8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd16e50-d47a-427d-b11f-f6c7831e36ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd16e50-d47a-427d-b11f-f6c7831e36ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa487fc-f8fa-421f-a575-127f45d8b7f5', 'volume_name': 'volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64712108-69f8-4c2a-bb8a-5d360448c679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64712108-69f8-4c2a-bb8a-5d360448c679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea32d45-fe21-4874-96e3-39adddd0e8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:03 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 2fa487fc-f8fa-421f-a575-127f45d8b7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5', 'volume_size': 1}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:03 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-73ccd636-ca31-46eb-9ac4-66387a005386" returned: 0 in 0.549s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-73ccd636-ca31-46eb-9ac4-66387a005386" released by "delete_volume" :: held 1.142s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['4fbe9b30-f648-415b-a656-b5266e5895fd', '291446a2-43d0-4341-8228-224289ddd83c', '796589d0-fafd-406a-90d6-53ee44933b88', 'b7204903-3779-43fd-b67e-957975caa913'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:04 devstack sudo[106760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:04 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:04 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb 1073741824" returned: 0 in 0.952s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:04 devstack sudo[106762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb
Sep 04 06:13:04 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (d490c4a7-3439-416e-b703-28085afde15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387590b-5a7f-437d-9f77-891618b78086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0387590b-5a7f-437d-9f77-891618b78086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090013889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9950afc7-c549-4563-a552-1deacf83a569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:04Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26566a8-232b-4288-b74b-23d5a488d2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26566a8-232b-4288-b74b-23d5a488d2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1429473f-7760-400d-9f2f-31b0ff7f9e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1429473f-7760-400d-9f2f-31b0ff7f9e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9950afc7-c549-4563-a552-1deacf83a569', 'volume_name': 'volume-9950afc7-c549-4563-a552-1deacf83a569', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddf9630-670f-478d-91fd-21a301b16451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ddf9630-670f-478d-91fd-21a301b16451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5d21ff-a544-46f1-9b57-ecdfbc436ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 9950afc7-c549-4563-a552-1deacf83a569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9950afc7-c549-4563-a552-1deacf83a569', 'volume_size': 1}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.477s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2995220f-eb25-40ff-bc4c-1f9322107f67 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-73ccd636-ca31-46eb-9ac4-66387a005386-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:04 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2065477133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa487fc-f8fa-421f-a575-127f45d8b7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:04Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 2fa487fc-f8fa-421f-a575-127f45d8b7f5 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:04 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09787aca-0792-4a0c-905b-d414ea888221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314edba3-375d-42cb-bb48-692d708b4ddb', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack sudo[106766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 1073741824
Sep 04 06:13:04 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa59d8f5-a20f-4564-a9ca-3f8a72544d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:04 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-314edba3-375d-42cb-bb48-692d708b4ddb (314edba3-375d-42cb-bb48-692d708b4ddb): created successfully
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa59d8f5-a20f-4564-a9ca-3f8a72544d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:04 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (1f43294b-f00e-411b-86a7-ca8e94f744af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:04 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-85a30a59-48b9-4083-8cdf-c0dbb7ba888e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (98b2d84b-78e5-4c5c-97ea-34660f97dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821f1576-1076-41da-8513-ebe26191b76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-0ab7b16c-e153-4c7a-96d7-12d18458031b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821f1576-1076-41da-8513-ebe26191b76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1972849112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310b736d-36cc-4c8b-8be0-cd6a506702e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:05Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048c8ee1-79cf-4768-8b6e-6b528d7fd8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048c8ee1-79cf-4768-8b6e-6b528d7fd8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02de75ab-eeaf-4e20-903f-e8db455ab429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02de75ab-eeaf-4e20-903f-e8db455ab429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310b736d-36cc-4c8b-8be0-cd6a506702e8', 'volume_name': 'volume-310b736d-36cc-4c8b-8be0-cd6a506702e8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0b8540-c7c9-4d57-b064-644d4b1706a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0b8540-c7c9-4d57-b064-644d4b1706a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec60c3b5-00bb-4cc3-9cc2-f843b6848b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 310b736d-36cc-4c8b-8be0-cd6a506702e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310b736d-36cc-4c8b-8be0-cd6a506702e8', 'volume_size': 1}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-0ab7b16c-e153-4c7a-96d7-12d18458031b-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-0ab7b16c-e153-4c7a-96d7-12d18458031b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-0ab7b16c-e153-4c7a-96d7-12d18458031b" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba6a856-ba9d-47bf-9768-b70298d4bf76]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:05 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b
Sep 04 06:13:05 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:05 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 1073741824" returned: 0 in 0.831s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:05 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5
Sep 04 06:13:05 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (901f0abc-4293-4769-9a1a-fe633027b260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61ebdf-40d4-4edc-a49c-0052735af787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a61ebdf-40d4-4edc-a49c-0052735af787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878700974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1e1696-7c54-4bc4-8a4b-37d436782aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:06Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de18ad0-3c8d-4735-ac8e-012c3192b198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de18ad0-3c8d-4735-ac8e-012c3192b198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8007051-3317-45a2-add0-ad8b172f75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8007051-3317-45a2-add0-ad8b172f75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c1e1696-7c54-4bc4-8a4b-37d436782aa9', 'volume_name': 'volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c682995b-b3bf-4f12-a256-9fc5b18f30a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c682995b-b3bf-4f12-a256-9fc5b18f30a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c683b25e-2ac3-4446-8f18-2b6344b6b055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:05 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume 1c1e1696-7c54-4bc4-8a4b-37d436782aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9', 'volume_size': 1}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:05 devstack sudo[106780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b
Sep 04 06:13:05 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:06 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5" returned: 0 in 0.354s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.398s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2090013889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9950afc7-c549-4563-a552-1deacf83a569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:04Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 9950afc7-c549-4563-a552-1deacf83a569 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:06 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea32d45-fe21-4874-96e3-39adddd0e8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c41c9-d80b-4bc8-9e0c-853b68ec71dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:06 devstack sudo[106783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 1073741824
Sep 04 06:13:06 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:06 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 (2fa487fc-f8fa-421f-a575-127f45d8b7f5): created successfully
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237c41c9-d80b-4bc8-9e0c-853b68ec71dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (0e9cf095-03e9-4382-9f62-a899248aa22d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7df22ff6-0d46-4c33-860d-b82c3a6923e7 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:06 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-0ab7b16c-e153-4c7a-96d7-12d18458031b" returned: 0 in 0.343s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-0ab7b16c-e153-4c7a-96d7-12d18458031b" released by "delete_volume" :: held 0.916s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['3f3ed004-8445-47db-b6e0-f8a660e69c84', 'a1564600-b833-4b88-9a5d-195488a0f7d7', 'b26b36d4-5da1-4b02-a67f-f36612864e0b', '9a495064-a4bc-43d7-b315-e5aef055f80a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:06 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:06 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Flow 'volume_create_manager' (2581d0b6-0f23-4bf0-a064-f55c17a3ae82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e7c452-edf9-4827-9099-a3ee99bbfc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e7c452-edf9-4827-9099-a3ee99bbfc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ea846b-3705-42aa-a2a0-5e9e672ddff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64ec0771ba64630b3e2a2cb3d1be531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:07Z,use_quota=True,user_id='a751290ff8d44c719fd17ebdc36b2fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad28166-d9b3-43f6-8877-33e1128aed86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad28166-d9b3-43f6-8877-33e1128aed86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b2662-afc9-41a9-b672-8898af3f143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.image.glance [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Creating Keystone auth plugin from conf {{(pid=87095) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Sep 04 06:13:06 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 1073741824" returned: 0 in 0.752s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:06 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:06 devstack sudo[106793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569
Sep 04 06:13:06 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.387s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:13:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-504dda2c-5210-4725-9277-d40cdf729839 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-0ab7b16c-e153-4c7a-96d7-12d18458031b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:07 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.909s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1972849112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310b736d-36cc-4c8b-8be0-cd6a506702e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:05Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 310b736d-36cc-4c8b-8be0-cd6a506702e8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:07 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:07 devstack sudo[106796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 1073741824
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5d21ff-a544-46f1-9b57-ecdfbc436ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9950afc7-c549-4563-a552-1deacf83a569', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:07 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e626156-b56e-4327-81ae-4a0779b5aab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761b2662-afc9-41a9-b672-8898af3f143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6ea846b-3705-42aa-a2a0-5e9e672ddff8', 'volume_name': 'volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8', 'volume_size': 1, 'image_id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13e8c2ea4f702465933236abac73c2d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b64ec0771ba64630b3e2a2cb3d1be531', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e49df1e0c0e6044074d1b0db5a942673190c75ea639d52e621a8380391e425f7b81d234557c8d4b640eb73a3286d8683036294ec0445fa51c30686673fea55c2', 'id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'created_at': datetime.datetime(2026, 9, 4, 4, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 13, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d3521a-a046-4681-801b-14efdaffede9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e541d90>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba3cd73-c5c4-4e0f-9e37-04fa409946d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba3cd73-c5c4-4e0f-9e37-04fa409946d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103d05f6-2e52-4453-bdad-08f7ab31bf2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8', 'volume_size': 1, 'image_id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13e8c2ea4f702465933236abac73c2d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b64ec0771ba64630b3e2a2cb3d1be531', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e49df1e0c0e6044074d1b0db5a942673190c75ea639d52e621a8380391e425f7b81d234557c8d4b640eb73a3286d8683036294ec0445fa51c30686673fea55c2', 'id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'created_at': datetime.datetime(2026, 9, 4, 4, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 13, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d3521a-a046-4681-801b-14efdaffede9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e541d90>}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Trying to clone e6ea846b-3705-42aa-a2a0-5e9e672ddff8 from image c3d3521a-a046-4681-801b-14efdaffede9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}]). {{(pid=87095) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Sep 04 06:13:07 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-9950afc7-c549-4563-a552-1deacf83a569 (9950afc7-c549-4563-a552-1deacf83a569): created successfully
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e626156-b56e-4327-81ae-4a0779b5aab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (d490c4a7-3439-416e-b703-28085afde15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:07 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-67b709e4-b9f8-48ae-b5bd-bd60011a69af tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Sep 04 06:13:07 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Image download 0.00 MB at 0.00 MB/s
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcebcb1d-54b0-47f2-a54c-78de59291e92]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-393c5364-8aaa-4d6f-8186-922768e369be-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:07 devstack sudo[106800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:07 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-393c5364-8aaa-4d6f-8186-922768e369be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-393c5364-8aaa-4d6f-8186-922768e369be" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-393c5364-8aaa-4d6f-8186-922768e369be" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf51591-7124-4efc-8612-006441c19678]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:07 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 1073741824" returned: 0 in 0.614s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:07 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be
Sep 04 06:13:07 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:07 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:07 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8
Sep 04 06:13:07 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:08 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8" returned: 0 in 0.321s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1878700974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c1e1696-7c54-4bc4-8a4b-37d436782aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a8e43c565584d1a9e0c3e618215271b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:06Z,use_quota=True,user_id='66db0f16cc524c2a9bab83b567d05cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Creating volume 1c1e1696-7c54-4bc4-8a4b-37d436782aa9 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:08 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec60c3b5-00bb-4cc3-9cc2-f843b6848b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310b736d-36cc-4c8b-8be0-cd6a506702e8', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:08 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 1073741824
Sep 04 06:13:08 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d13b19-8940-4b83-897d-d0cff6da728b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:08 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 (310b736d-36cc-4c8b-8be0-cd6a506702e8): created successfully
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d13b19-8940-4b83-897d-d0cff6da728b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (98b2d84b-78e5-4c5c-97ea-34660f97dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:08 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be" returned: 0 in 0.561s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:08 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-890b7297-9866-45b8-b346-da50af58cf20 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:08 devstack sudo[106821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be
Sep 04 06:13:08 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 1 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Temporary image c3d3521a-a046-4681-801b-14efdaffede9 is fetched for user a751290ff8d44c719fd17ebdc36b2fda. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1cc661-0f32-43f6-b9e9-0ed7af0816fc]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:08 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-393c5364-8aaa-4d6f-8186-922768e369be" returned: 0 in 0.342s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:08 devstack sudo[106827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:08 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-393c5364-8aaa-4d6f-8186-922768e369be" released by "delete_volume" :: held 0.980s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['8c2160fd-ec52-459d-8674-5915b9a2fc47', '2f599733-a476-44df-b785-ca2f15d907ed', 'e365acb5-5693-449f-833f-a3c9538385a4', '4853cf29-2880-4e0b-942a-5abea8009687'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:08 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 1073741824" returned: 0 in 0.649s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-71926df5-5cbd-4275-b88c-acee772fd2fa-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:08 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:08 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-71926df5-5cbd-4275-b88c-acee772fd2fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:09 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 0 in 0.480s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:09 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9
Sep 04 06:13:09 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-71926df5-5cbd-4275-b88c-acee772fd2fa" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-71926df5-5cbd-4275-b88c-acee772fd2fa" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleting offline snapshot 71926df5-5cbd-4275-b88c-acee772fd2fa of volume 3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] snapshot_file for this snap is: volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e125b7-8e86-4e57-9cbc-a87a2ed12995]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:09 devstack sudo[106837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:09 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:09 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.428s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:13:09 devstack sudo[106839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa
Sep 04 06:13:09 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:09 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b66e146b-f561-4b9d-9384-a5ae862cee1f tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-393c5364-8aaa-4d6f-8186-922768e369be-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c683b25e-2ac3-4446-8f18-2b6344b6b055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f337aff-72d4-49ec-8127-599bf179fd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Volume volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 (1c1e1696-7c54-4bc4-8a4b-37d436782aa9): created successfully
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f337aff-72d4-49ec-8127-599bf179fd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Flow 'volume_create_manager' (901f0abc-4293-4769-9a1a-fe633027b260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ece792ae-5413-4f2b-a6d4-3e667f494df5 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created volume successfully.
Sep 04 06:13:09 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 1 in 0.511s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ea846b-3705-42aa-a2a0-5e9e672ddff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b64ec0771ba64630b3e2a2cb3d1be531',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:07Z,use_quota=True,user_id='a751290ff8d44c719fd17ebdc36b2fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Creating volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:09 devstack sudo[106848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1073741824
Sep 04 06:13:09 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:09 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa" returned: 0 in 0.540s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b16e970-3dac-4378-b7b0-d65914b537fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8235dc-160e-49bd-bcbb-cae0ac683f35]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:09 devstack sudo[106853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb
Sep 04 06:13:09 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:10 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1073741824" returned: 0 in 0.500s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:10 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8
Sep 04 06:13:10 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:10 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb" returned: 0 in 0.463s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:10 devstack sudo[106864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa
Sep 04 06:13:10 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:10 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" returned: 0 in 0.368s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-1c1e1696-7c54-4bc4-8a4b-37d436782aa9-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-1c1e1696-7c54-4bc4-8a4b-37d436782aa9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Attempting download of c3d3521a-a046-4681-801b-14efdaffede9 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}])) to volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8b7a0-ac6f-4f50-9427-0a9d5238138e]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39bb00b-66ec-479f-9c97-8cb68a388a9f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:10 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa" returned: 0 in 0.513s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:10 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa
Sep 04 06:13:10 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:10 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc
Sep 04 06:13:10 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:10 devstack sudo[106873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9
Sep 04 06:13:10 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:11 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb.71926df5-5cbd-4275-b88c-acee772fd2fa" returned: 0 in 0.315s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-71926df5-5cbd-4275-b88c-acee772fd2fa" released by "_delete_snapshot" :: held 2.024s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" released by "delete_snapshot" :: held 2.063s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:11 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" returned: 0 in 0.485s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack sudo[106881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc
Sep 04 06:13:11 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:11 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9
Sep 04 06:13:11 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['de01d3b2-69c6-4a43-9303-70f010445498', '78a3a976-d81c-4200-9779-ef64da1990b3', '529a30e8-05ae-49a3-be0e-792f4e5736cc', 'e050c489-b2f8-444d-bf53-e011b41d0062'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:11 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Delete snapshot completed successfully.
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e8966ffd-70ce-47ac-9040-1bc2030c75f3 tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-71926df5-5cbd-4275-b88c-acee772fd2fa-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:11 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc" returned: 1 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3d3521a-a046-4681-801b-14efdaffede9_wpcy76gc' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3edf947-39e5-44eb-93b3-841b987f40ab]: (4, 'raw') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" returned: 0 in 0.319s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-1c1e1696-7c54-4bc4-8a4b-37d436782aa9" released by "delete_volume" :: held 0.863s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['fc902bb7-d36a-4158-be9c-abae3c6cd8ed', '8034f6fd-b18a-49a3-a1c5-d68d164d8f57', 'b2b8d84e-adff-4260-b074-59cdc02968e4', '9256aebe-ad6d-40ff-9c65-752ec9c90991'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:11 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:11 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-310b736d-36cc-4c8b-8be0-cd6a506702e8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:11 devstack sudo[106894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:11 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-310b736d-36cc-4c8b-8be0-cd6a506702e8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:11 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-310b736d-36cc-4c8b-8be0-cd6a506702e8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-310b736d-36cc-4c8b-8be0-cd6a506702e8" acquired by "delete_volume" :: waited 0.037s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4d46f2-cb51-4c38-8557-553911e91f67]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:11 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD
Sep 04 06:13:11 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.360s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:12 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:12 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8
Sep 04 06:13:12 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7ec8a4bd-287f-4e93-b7fb-122944b92bd1 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-1c1e1696-7c54-4bc4-8a4b-37d436782aa9-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-3b16e970-3dac-4378-b7b0-d65914b537fb-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-3b16e970-3dac-4378-b7b0-d65914b537fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:12 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD" returned: 1 in 0.576s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD' failed. Not Retrying. {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] c3d3521a-a046-4681-801b-14efdaffede9 was raw, converting to qcow2 {{(pid=87095) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e56612-12c3-420e-83f8-ab1001d11630]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:12 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:12 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8" returned: 0 in 0.554s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:12 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack sudo[106914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8
Sep 04 06:13:12 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb
Sep 04 06:13:12 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:12 devstack sudo[106917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:12 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-310b736d-36cc-4c8b-8be0-cd6a506702e8" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:12 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-310b736d-36cc-4c8b-8be0-cd6a506702e8" released by "delete_volume" :: held 0.991s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:12 devstack sudo[106928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb
Sep 04 06:13:12 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:12 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['5b2fb040-3062-44db-8602-e17baeb67c18', '78862203-05a7-4a58-90b2-8fd81cd54bc7', '8eaa9c44-b251-4f57-9c33-3e34c6f30f42', 'c4d6e127-a58d-4bf8-a88c-c09bb294b666'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:13 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.444s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:13 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" returned: 0 in 0.729s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3d3521a-a046-4681-801b-14efdaffede9_clit2e57devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:13:13 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Converted 0.00 MB image at 0.00 MB/s
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:13 devstack sudo[106931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:13 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:13 devstack sudo[106932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1G
Sep 04 06:13:13 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:13 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3b16e970-3dac-4378-b7b0-d65914b537fb" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-quobyte-3b16e970-3dac-4378-b7b0-d65914b537fb" released by "delete_volume" :: held 0.960s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Created reservations ['5f32fa7e-df81-461d-8106-7009c325e456', 'c84ceabd-b89c-409d-b213-5178188e222a', '93d4358d-9949-4136-bf37-f7f4789fbec3', '197985b2-7469-4fba-b7fe-c5bf2dee2646'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:13 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9ba27bf7-8d48-4401-b298-c227e2ba448e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-310b736d-36cc-4c8b-8be0-cd6a506702e8-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:13 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 1G" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Downloaded image c3d3521a-a046-4681-801b-14efdaffede9 ((None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}])) to volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8 successfully. {{(pid=87095) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Temporary image c3d3521a-a046-4681-801b-14efdaffede9 for user a751290ff8d44c719fd17ebdc36b2fda is deleted. {{(pid=87095) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.volume_utils [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Marking volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8 as bootable. {{(pid=87095) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Copying metadata from image c3d3521a-a046-4681-801b-14efdaffede9 to e6ea846b-3705-42aa-a2a0-5e9e672ddff8. {{(pid=87095) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Creating volume glance metadata for volume e6ea846b-3705-42aa-a2a0-5e9e672ddff8 backed by image c3d3521a-a046-4681-801b-14efdaffede9 with: {'image_id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '13e8c2ea4f702465933236abac73c2d0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87095) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 04 06:13:13 devstack sudo[106940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:13 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (103d05f6-2e52-4453-bdad-08f7ab31bf2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8', 'volume_size': 1, 'image_id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3d3521a-a046-4681-801b-14efdaffede9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '13e8c2ea4f702465933236abac73c2d0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b64ec0771ba64630b3e2a2cb3d1be531', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e49df1e0c0e6044074d1b0db5a942673190c75ea639d52e621a8380391e425f7b81d234557c8d4b640eb73a3286d8683036294ec0445fa51c30686673fea55c2', 'id': 'c3d3521a-a046-4681-801b-14efdaffede9', 'created_at': datetime.datetime(2026, 9, 4, 4, 13, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 4, 13, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3d3521a-a046-4681-801b-14efdaffede9/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x73201e541d90>}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2f18a6-f6cc-4585-9448-7e3936729bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:13 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Volume volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 (e6ea846b-3705-42aa-a2a0-5e9e672ddff8): created successfully
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2f18a6-f6cc-4585-9448-7e3936729bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Flow 'volume_create_manager' (2581d0b6-0f23-4bf0-a064-f55c17a3ae82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b268b338-b6ed-4c2a-b4cf-26a7dd1355c4 tempest-VolumeImageDependencyTests-790294184 None] Created volume successfully.
Sep 04 06:13:13 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Deleted volume successfully.
Sep 04 06:13:13 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8923fa2c-f037-4979-a803-73e65dcefe9c tempest-CreateVolumesFromSnapshotTest-202810352 None] Lock "cinder-3b16e970-3dac-4378-b7b0-d65914b537fb-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-9950afc7-c549-4563-a552-1deacf83a569-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-9950afc7-c549-4563-a552-1deacf83a569-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-9950afc7-c549-4563-a552-1deacf83a569" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-9950afc7-c549-4563-a552-1deacf83a569" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b2b39-7651-4dcf-b391-e8374704d048]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:14 devstack sudo[106943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569
Sep 04 06:13:14 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Acquiring lock "cinder-e6ea846b-3705-42aa-a2a0-5e9e672ddff8-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "cinder-e6ea846b-3705-42aa-a2a0-5e9e672ddff8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Acquiring lock "cinder-quobyte-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "cinder-quobyte-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" acquired by "delete_volume" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d2d0f-dd1f-42c8-9b85-548002eaaad7]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:14 devstack sudo[106945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8
Sep 04 06:13:14 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:14 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569" returned: 0 in 0.597s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:14 devstack sudo[106950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569
Sep 04 06:13:14 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:15 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" returned: 0 in 0.491s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:15 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9950afc7-c549-4563-a552-1deacf83a569" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:15 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8
Sep 04 06:13:15 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-9950afc7-c549-4563-a552-1deacf83a569" released by "delete_volume" :: held 0.978s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['fa8269b4-f5f1-4af6-a7dd-8bce413d2243', '9fd1c281-82bd-49b5-a09a-f99509d967ea', '92dddd63-ad04-4852-8130-177d0e96c198', 'd0ba1f0f-61d8-4f84-bae4-579ccba6a433'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:15 devstack sudo[106958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:15 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:15 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" returned: 0 in 0.426s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "cinder-quobyte-e6ea846b-3705-42aa-a2a0-5e9e672ddff8" released by "delete_volume" :: held 0.976s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Created reservations ['f19fea16-7266-4fdb-ab39-0addf3e8117c', '4ecd1466-8e9f-429b-93a2-4e470f2fa000', 'ccf50667-65d3-416e-9639-ccf420a2b30f', 'e0097091-bfb9-459a-be65-b7a08868b9bf'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:15 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-787612c1-262c-4fb3-9791-b01766e60e8e tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-9950afc7-c549-4563-a552-1deacf83a569-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:15 devstack sudo[106962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:15 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:16 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Deleted volume successfully.
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-cf228b28-d697-4ba6-8c24-c9309ef9395b tempest-VolumeImageDependencyTests-790294184 None] Lock "cinder-e6ea846b-3705-42aa-a2a0-5e9e672ddff8-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-2fa487fc-f8fa-421f-a575-127f45d8b7f5-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-2fa487fc-f8fa-421f-a575-127f45d8b7f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-2fa487fc-f8fa-421f-a575-127f45d8b7f5" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-2fa487fc-f8fa-421f-a575-127f45d8b7f5" acquired by "delete_volume" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8b527-fcff-4d0d-bcb1-6a59d639ed0e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:16 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5
Sep 04 06:13:16 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:17 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:17 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5
Sep 04 06:13:17 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:17 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-2fa487fc-f8fa-421f-a575-127f45d8b7f5" returned: 0 in 0.317s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-2fa487fc-f8fa-421f-a575-127f45d8b7f5" released by "delete_volume" :: held 0.842s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['b4652c28-39ce-4252-9382-8a5cc932f969', '921d12b6-be9b-4aad-85bc-9b1a3dd36649', '9a7a6cec-0304-446f-b0eb-b89a5ba4b257', 'dfdb2835-bb9a-416a-bb47-f724032c0c39'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:17 devstack sudo[106973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:17 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-314edba3-375d-42cb-bb48-692d708b4ddb-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-314edba3-375d-42cb-bb48-692d708b4ddb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-314edba3-375d-42cb-bb48-692d708b4ddb" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-314edba3-375d-42cb-bb48-692d708b4ddb" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc1a42-8be4-4f09-a001-65c5bd687bee]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:18 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb
Sep 04 06:13:18 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:18 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.512s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-edabc81b-4f88-4e9a-94ed-36b48ad9fad8 tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-2fa487fc-f8fa-421f-a575-127f45d8b7f5-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:18 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:18 devstack sudo[106982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb
Sep 04 06:13:18 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:18 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-314edba3-375d-42cb-bb48-692d708b4ddb" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-314edba3-375d-42cb-bb48-692d708b4ddb" released by "delete_volume" :: held 0.851s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['dccfa0b1-4b2a-40ac-bb6c-1f4c79c619da', 'd655fbf0-3885-4adb-a2b9-17d7dd9e499e', '4f1caa07-f22e-4216-a090-7514cdc0a42c', '9c74ae61-2ccd-47e4-9734-9a61ae506a35'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:18 devstack sudo[106985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:18 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Flow 'volume_create_manager' (71ea55ed-5e30-4518-ad7e-7171156c66f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f9f333-fd7c-45da-b346-14bc7512646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56f9f333-fd7c-45da-b346-14bc7512646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2110723329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13c3342-c7b4-47ab-8214-9bf2101bad9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa98e4375a04b69b5b524d7945d7bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:19Z,use_quota=True,user_id='269fa9f7802e4cbbae84bf0093a0e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe22810-5f11-4b52-9d15-1be50b172ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe22810-5f11-4b52-9d15-1be50b172ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c157da4e-fcf4-4fa3-8786-b64fa3b2b058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c157da4e-fcf4-4fa3-8786-b64fa3b2b058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f13c3342-c7b4-47ab-8214-9bf2101bad9b', 'volume_name': 'volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab1a29c-91a8-4ddb-ba1c-222397e09cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab1a29c-91a8-4ddb-ba1c-222397e09cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d968d5db-0686-4d4d-915c-d81895413a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Volume f13c3342-c7b4-47ab-8214-9bf2101bad9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b', 'volume_size': 1}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2110723329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f13c3342-c7b4-47ab-8214-9bf2101bad9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa98e4375a04b69b5b524d7945d7bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:19Z,use_quota=True,user_id='269fa9f7802e4cbbae84bf0093a0e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Creating volume f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:19 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-96ded3e5-2ed1-4d1b-8a6d-a1451b532414-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:19 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b 1073741824
Sep 04 06:13:19 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-96ded3e5-2ed1-4d1b-8a6d-a1451b532414-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:19 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "cinder-quobyte-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.360s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" acquired by "delete_volume" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95fe1b0-e64b-4196-8b36-0830fc00070e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c1ba6572-065a-4514-9c0e-c9c070924deb tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-314edba3-375d-42cb-bb48-692d708b4ddb-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:19 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414
Sep 04 06:13:19 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:19 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b 1073741824" returned: 0 in 0.692s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:19 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" returned: 0 in 0.541s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:19 devstack sudo[106999]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414
Sep 04 06:13:19 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:19 devstack sudo[107001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:19 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:20 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-quobyte-96ded3e5-2ed1-4d1b-8a6d-a1451b532414" released by "delete_volume" :: held 0.964s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:20 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d968d5db-0686-4d4d-915c-d81895413a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb0d6d-fe3f-41a1-982d-0f36689dfa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Created reservations ['0c961b77-770d-47ab-9faf-cd8784e49034', '84a0c7a0-065f-45f3-aff1-8f432b6b995b', '954bba45-ba66-450e-91d3-cd64976bfb38', '34775200-7485-4e1f-a127-a7b55229a25c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Volume volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b (f13c3342-c7b4-47ab-8214-9bf2101bad9b): created successfully
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ecb0d6d-fe3f-41a1-982d-0f36689dfa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Flow 'volume_create_manager' (71ea55ed-5e30-4518-ad7e-7171156c66f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-98c3e48b-675a-42e5-8ecd-70c8623d3fa8 tempest-VolumeDependencyTests-268105327 None] Created volume successfully.
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:20 devstack sudo[107005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:20 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:20 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:20 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Deleted volume successfully.
Sep 04 06:13:20 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bc56016c-ce2f-4c63-b91f-e4dd9c408c8d tempest-CreateVolumesFromSourceVolumeTest-1575841297 None] Lock "cinder-96ded3e5-2ed1-4d1b-8a6d-a1451b532414-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Creating offline snapshot 4dc28eae-6b18-4ab5-b021-eb8a696f6576 of volume f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[eade2f17-f892-4ce9-8f63-208a634f7ea1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:21 devstack sudo[107010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:21 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:21 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:21 devstack sudo[107016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 1G
Sep 04 06:13:21 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:22 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 1G" returned: 0 in 0.654s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:22 devstack sudo[107022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:22 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:22 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.356s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:22 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 is being set with open permissions: ugo+rw
Sep 04 06:13:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:22 devstack sudo[107028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:22 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:23 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.352s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:23 devstack sudo[107031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info
Sep 04 06:13:23 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:23 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:23 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info is being set with open permissions: ugo+rw
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:23 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info
Sep 04 06:13:23 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:23 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.info" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.545s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5302766f-0e3d-4713-b362-4b3f5f86630d tempest-VolumeDependencyTests-268105327 None] Create snapshot completed successfully
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Flow 'volume_create_manager' (f97a5942-c104-4b31-995f-b97db84a0e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de659543-06de-4732-9a45-175f56867fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de659543-06de-4732-9a45-175f56867fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1524103660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57e7d7ee-6e85-4ebd-abe6-076cf4fe954d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fa98e4375a04b69b5b524d7945d7bc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4dc28eae-6b18-4ab5-b021-eb8a696f6576,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:25Z,use_quota=True,user_id='269fa9f7802e4cbbae84bf0093a0e044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd21711f-46ac-4b44-8908-e743bdf8bec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd21711f-46ac-4b44-8908-e743bdf8bec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3e136d-7ea3-4bbc-bc31-ae255e82c92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3e136d-7ea3-4bbc-bc31-ae255e82c92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57e7d7ee-6e85-4ebd-abe6-076cf4fe954d', 'volume_name': 'volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d', 'volume_size': 1, 'snapshot_id': '4dc28eae-6b18-4ab5-b021-eb8a696f6576'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe4b16f-d08b-4ec4-ae10-fe17e4733256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe4b16f-d08b-4ec4-ae10-fe17e4733256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f922466c-e542-4e27-9e70-df038e354c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Volume 57e7d7ee-6e85-4ebd-abe6-076cf4fe954d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d', 'volume_size': 1, 'snapshot_id': '4dc28eae-6b18-4ab5-b021-eb8a696f6576'}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Creating volume 57e7d7ee-6e85-4ebd-abe6-076cf4fe954d from snapshot 4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] snapshot: 4dc28eae-6b18-4ab5-b021-eb8a696f6576, volume: 57e7d7ee-6e85-4ebd-abe6-076cf4fe954d,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f512de40-c235-45a8-934f-ed702aedb5ab]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:25 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:25 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:26 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.658s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[357324da-2cb6-47da-947b-01d2da0fae15]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:26 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:26 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:27 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.658s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:27 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d
Sep 04 06:13:27 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:27 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-7d1269ed-0cfe-43a1-b2d1-b88c00b7f0e2 tempest-ProjectAdminTests-1491261051 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8068084716797, 'free_capacity_gb': 1773.8068084716797, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87095) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (4f3e6158-9694-46ca-b968-174e5ae245e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360fd7a3-5836-4bfd-abfa-963054f39b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360fd7a3-5836-4bfd-abfa-963054f39b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501513508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78926fba-8c4e-4f70-99b0-76d610d97b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:31Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f1ebae-0179-43be-98e9-a34cc628c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44f1ebae-0179-43be-98e9-a34cc628c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8877c625-29e1-4c8e-aec3-eb2e26e6bcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8877c625-29e1-4c8e-aec3-eb2e26e6bcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78926fba-8c4e-4f70-99b0-76d610d97b19', 'volume_name': 'volume-78926fba-8c4e-4f70-99b0-76d610d97b19', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d95ae9-e670-4cb7-b2e1-d27aa91682b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d95ae9-e670-4cb7-b2e1-d27aa91682b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0ea9f-bda8-4718-8cf7-e6196c97c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Volume 78926fba-8c4e-4f70-99b0-76d610d97b19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78926fba-8c4e-4f70-99b0-76d610d97b19', 'volume_size': 1}
Sep 04 06:13:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:33 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" returned: 0 in 6.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:13:33 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Converted 1024.00 MB image at 160.85 MB/s
Sep 04 06:13:33 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d is being set with open permissions: ugo+rw
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:33 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d
Sep 04 06:13:33 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:33 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" released by "_copy_volume_from_snapshot" :: held 8.137s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" released by "_create_volume_from_snapshot" :: held 8.212s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.228s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.469s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-501513508',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78926fba-8c4e-4f70-99b0-76d610d97b19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:31Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Creating volume 78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:33 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:33 devstack sudo[107069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 1073741824
Sep 04 06:13:33 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f922466c-e542-4e27-9e70-df038e354c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d', 'volume_size': 1, 'snapshot_id': '4dc28eae-6b18-4ab5-b021-eb8a696f6576'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b28454-7f5c-4d73-ad62-ebc930bf75a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:33 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Volume volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d (57e7d7ee-6e85-4ebd-abe6-076cf4fe954d): created successfully
Sep 04 06:13:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76b28454-7f5c-4d73-ad62-ebc930bf75a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Flow 'volume_create_manager' (f97a5942-c104-4b31-995f-b97db84a0e58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-80bfb529-24af-4d7b-ba6e-ea73e3cfe8ec tempest-VolumeDependencyTests-268105327 None] Created volume successfully.
Sep 04 06:13:34 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 1073741824" returned: 0 in 0.649s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:34 devstack sudo[107076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19
Sep 04 06:13:34 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-4dc28eae-6b18-4ab5-b021-eb8a696f6576-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-4dc28eae-6b18-4ab5-b021-eb8a696f6576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Deleting offline snapshot 4dc28eae-6b18-4ab5-b021-eb8a696f6576 of volume f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] snapshot_file for this snap is: volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[397d094c-ae90-4a93-82b4-0c20cd41482d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:34 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19" returned: 0 in 0.296s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:34 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:34 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4f0ea9f-bda8-4718-8cf7-e6196c97c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78926fba-8c4e-4f70-99b0-76d610d97b19', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277727f5-d2ed-4784-a6ad-eae3dc75a5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Volume volume-78926fba-8c4e-4f70-99b0-76d610d97b19 (78926fba-8c4e-4f70-99b0-76d610d97b19): created successfully
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277727f5-d2ed-4784-a6ad-eae3dc75a5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (4f3e6158-9694-46ca-b968-174e5ae245e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fe8dbaff-7cfc-40c0-bd0b-9db9f34682be tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:13:35 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.463s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf1c01d-d3cf-470c-b111-13328b23a045]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:35 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:35 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:35 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.602s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:35 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:35 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Creating offline snapshot 4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d of volume 78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[669646d2-5181-4bbb-bf6d-66eb3ad22746]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:36 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19
Sep 04 06:13:36 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:36 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:36 devstack sudo[107098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576
Sep 04 06:13:36 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:36 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:36 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d 1G
Sep 04 06:13:36 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:36 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b.4dc28eae-6b18-4ab5-b021-eb8a696f6576" returned: 0 in 0.364s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=186,cinder:UPDATE=252,cinder:INSERT=64,cinder:DELETE=25 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=253,cinder:SELECT=176,cinder:INSERT=69,cinder:DELETE=22 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-4dc28eae-6b18-4ab5-b021-eb8a696f6576" released by "_delete_snapshot" :: held 2.011s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" released by "delete_snapshot" :: held 2.045s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Created reservations ['99003120-b193-43f9-af87-6d800d83f76e', '7c08d5f2-2cec-4680-8618-0a33278c5525', 'e38c6987-2931-4b95-82d9-da3399e40977', 'ddd8d1b0-fc62-4db5-9ac2-e59419d55381'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Delete snapshot completed successfully.
Sep 04 06:13:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-15ee5446-9e28-4cf3-ab18-f0a68d690154 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-4dc28eae-6b18-4ab5-b021-eb8a696f6576-delete_snapshot" released by "delete_snapshot" :: held 2.222s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:37 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d 1G" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78926fba-8c4e-4f70-99b0-76d610d97b19 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:37 devstack sudo[107109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78926fba-8c4e-4f70-99b0-76d610d97b19 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d
Sep 04 06:13:37 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:37 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78926fba-8c4e-4f70-99b0-76d610d97b19 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" returned: 0 in 0.309s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d is being set with open permissions: ugo+rw
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:37 devstack sudo[107114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d
Sep 04 06:13:37 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:37 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:37 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info
Sep 04 06:13:37 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-f13c3342-c7b4-47ab-8214-9bf2101bad9b-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-f13c3342-c7b4-47ab-8214-9bf2101bad9b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:37 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info is being set with open permissions: ugo+rw
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:37 devstack sudo[107120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info
Sep 04 06:13:37 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b18986d-8497-4145-bcce-366974caac67]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:38 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:38 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:38 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.info" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c134784-ba0f-41f9-b0ca-017d66ea97fc tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:13:38 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.455s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:38 devstack sudo[107162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b
Sep 04 06:13:38 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:38 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f13c3342-c7b4-47ab-8214-9bf2101bad9b" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-f13c3342-c7b4-47ab-8214-9bf2101bad9b" released by "delete_volume" :: held 0.802s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Created reservations ['08effdc6-5a37-420a-90f1-8f457cd2a18f', 'a67284e1-b62a-4c97-9228-cd4f8bdc47cb', '31e78f6c-7211-46a1-afe3-bb5ce55c19b2', 'd1cf8c31-71b3-4cc9-a2f2-b2d5ad817260'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:38 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:38 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "cinder-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Acquiring lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:39 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.316s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Deleted volume successfully.
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64dc65f-594a-4955-b56f-f8359f535e34]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46c60b20-33c5-4b9b-9a8b-b69ccd707246 tempest-VolumeDependencyTests-268105327 None] Lock "cinder-f13c3342-c7b4-47ab-8214-9bf2101bad9b-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot 4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d of volume 78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[566218dd-1c30-4287-8b5a-bdcc82ab8f77]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:39 devstack sudo[107170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d
Sep 04 06:13:39 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:39 devstack sudo[107171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d
Sep 04 06:13:39 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:39 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" returned: 0 in 0.435s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:39 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d
Sep 04 06:13:39 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:39 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78926fba-8c4e-4f70-99b0-76d610d97b19(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[68348ba7-6183-4b1b-ab5b-927f7b1eeb87]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:39 devstack sudo[107182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19
Sep 04 06:13:39 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:39 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" returned: 0 in 0.269s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "cinder-quobyte-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d" released by "delete_volume" :: held 0.769s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Created reservations ['e3929b85-d4da-4684-b402-f0104fc61feb', '54846832-2fc7-4c35-8150-65b3aea188eb', '4fc8d93c-a4cf-429f-9166-cd8845ea8737', '64653172-0bca-498f-9512-7637fe49ac84'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:40 devstack sudo[107185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:40 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:40 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:40 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d
Sep 04 06:13:40 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:40 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.443s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Deleted volume successfully.
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0e67cfaf-9cff-47c0-8eb8-9de6807ac15d tempest-VolumeDependencyTests-268105327 None] Lock "cinder-57e7d7ee-6e85-4ebd-abe6-076cf4fe954d-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:40 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" returned: 0 in 0.508s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:40 devstack sudo[107197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d
Sep 04 06:13:40 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:41 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19.4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d" released by "_delete_snapshot" :: held 1.743s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" released by "delete_snapshot" :: held 1.774s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Created reservations ['751414b1-d567-475a-a571-f85e4f35debe', '635a19f4-e562-4955-8e46-1bd88ec446ae', '160a1246-9db3-4308-bde4-46677f598d46', '204b98a9-f4cc-493a-9821-0c82d002b011'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-5e8119cb-b594-4a9b-89bf-bebb80c9f51b tempest-ProjectMemberTests-12378103 None] Lock "cinder-4c9403c0-3cf8-4f3e-9d3d-bfacd3d4447d-delete_snapshot" released by "delete_snapshot" :: held 1.970s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-78926fba-8c4e-4f70-99b0-76d610d97b19-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-78926fba-8c4e-4f70-99b0-76d610d97b19-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[659d0820-a67f-42df-b083-4659594bc0e4]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:41 devstack sudo[107201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19
Sep 04 06:13:41 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:42 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:42 devstack sudo[107206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19
Sep 04 06:13:42 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:42 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-78926fba-8c4e-4f70-99b0-76d610d97b19" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-78926fba-8c4e-4f70-99b0-76d610d97b19" released by "delete_volume" :: held 0.810s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Created reservations ['930a4ae2-abde-4e9e-84b1-bbbe46d15378', '491967d2-1569-4839-8a76-d72cd64dd893', 'cc9296d0-e686-4500-8d76-9c798d1ba390', '3d33211b-7285-470f-b5c2-e8c80cdddb90'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:42 devstack sudo[107209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:42 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:42 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:13:42 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3dc17fc8-5320-4c88-acb5-55f84025e3c7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-78926fba-8c4e-4f70-99b0-76d610d97b19-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (230dfcb8-687f-42fb-89e4-5d44075bf65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218ca781-b937-41e3-b21a-53e6ab766922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (218ca781-b937-41e3-b21a-53e6ab766922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464266323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e1eb13-3ac1-456c-81c3-b23947ac4a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:43Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13335636-c2b3-4683-8b52-16613fac6ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13335636-c2b3-4683-8b52-16613fac6ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b619b85c-9eb9-48fc-809f-229cc5c7fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b619b85c-9eb9-48fc-809f-229cc5c7fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e1eb13-3ac1-456c-81c3-b23947ac4a96', 'volume_name': 'volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e644775e-a1f2-4c2c-beab-81d2d7492dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e644775e-a1f2-4c2c-beab-81d2d7492dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d0e38e-a42f-426d-b558-7f8283d7bd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Volume d6e1eb13-3ac1-456c-81c3-b23947ac4a96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96', 'volume_size': 1}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464266323',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e1eb13-3ac1-456c-81c3-b23947ac4a96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:43Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Creating volume d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:43 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:43 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 1073741824
Sep 04 06:13:43 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:44 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 1073741824" returned: 0 in 0.588s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:44 devstack sudo[107218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96
Sep 04 06:13:44 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Flow 'volume_create_manager' (1e2233d9-0bb5-43b2-944a-f11a2a44e8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf93881-c224-4151-9588-a1055f21e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf93881-c224-4151-9588-a1055f21e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b569ac87-c494-4c2b-b797-2c3087b168ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6864493dad45998c0349cdb1210d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:44Z,use_quota=True,user_id='4aa58cb4e8674c44b3a696f75fc3a4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06aeae1-c73d-428e-bc63-55a431be1840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c06aeae1-c73d-428e-bc63-55a431be1840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7c6dca-282e-4ae9-b419-eb168c3a13ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7c6dca-282e-4ae9-b419-eb168c3a13ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b569ac87-c494-4c2b-b797-2c3087b168ff', 'volume_name': 'volume-b569ac87-c494-4c2b-b797-2c3087b168ff', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad4ac6f-7c82-48f1-985f-f813c9395ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad4ac6f-7c82-48f1-985f-f813c9395ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea62f41-df8b-4c2c-aa77-1564d8b1b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Volume b569ac87-c494-4c2b-b797-2c3087b168ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b569ac87-c494-4c2b-b797-2c3087b168ff', 'volume_size': 1}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:44 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.028s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b569ac87-c494-4c2b-b797-2c3087b168ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6864493dad45998c0349cdb1210d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:44Z,use_quota=True,user_id='4aa58cb4e8674c44b3a696f75fc3a4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Creating volume b569ac87-c494-4c2b-b797-2c3087b168ff {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:44 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75d0e38e-a42f-426d-b558-7f8283d7bd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565aeba7-1943-4f98-b6fb-322411c248b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:44 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff 1073741824
Sep 04 06:13:44 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:44 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Volume volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 (d6e1eb13-3ac1-456c-81c3-b23947ac4a96): created successfully
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (565aeba7-1943-4f98-b6fb-322411c248b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (230dfcb8-687f-42fb-89e4-5d44075bf65c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b9d3e9a2-e350-427a-89fe-875651bbdc18 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:13:44 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff 1073741824" returned: 0 in 0.458s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:44 devstack sudo[107227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff
Sep 04 06:13:44 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:45 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea62f41-df8b-4c2c-aa77-1564d8b1b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b569ac87-c494-4c2b-b797-2c3087b168ff', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28703729-8755-4bea-abf4-9ee622278184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:45 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Volume volume-b569ac87-c494-4c2b-b797-2c3087b168ff (b569ac87-c494-4c2b-b797-2c3087b168ff): created successfully
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28703729-8755-4bea-abf4-9ee622278184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Flow 'volume_create_manager' (1e2233d9-0bb5-43b2-944a-f11a2a44e8e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-57f72a5f-2eb2-405c-801a-2f24c2d9e38b tempest-CinderUnicodeTest-206348574 None] Created volume successfully.
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Creating offline snapshot 688cb70d-dd69-49fd-8f67-fd3a3725ab36 of volume d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b2e9d-155d-4fc1-8829-fe13d3da6a3a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:45 devstack sudo[107230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96
Sep 04 06:13:45 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:46 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" returned: 0 in 0.377s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:46 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 1G
Sep 04 06:13:46 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:46 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 1G" returned: 0 in 0.506s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:46 devstack sudo[107242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36
Sep 04 06:13:46 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:46 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36" returned: 0 in 0.476s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:46 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 is being set with open permissions: ugo+rw
Sep 04 06:13:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:47 devstack sudo[107247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36
Sep 04 06:13:47 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Flow 'volume_create_manager' (987b31f8-ba5e-45a6-ba42-694ff1208adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af78c85a-59a3-47b9-bed0-c30bbc8b173c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af78c85a-59a3-47b9-bed0-c30bbc8b173c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-548195547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5adc36f-10c4-4847-8377-63fccc48fdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6864493dad45998c0349cdb1210d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:47Z,use_quota=True,user_id='4aa58cb4e8674c44b3a696f75fc3a4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7bb2de-852c-4fc0-baa1-38dbb2fce954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7bb2de-852c-4fc0-baa1-38dbb2fce954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef8c856-d2ce-4577-8f25-6852ac9a95b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef8c856-d2ce-4577-8f25-6852ac9a95b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5adc36f-10c4-4847-8377-63fccc48fdc1', 'volume_name': 'volume-f5adc36f-10c4-4847-8377-63fccc48fdc1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f9eb6-69a1-4739-96c7-a18853c905e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (030f9eb6-69a1-4739-96c7-a18853c905e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7fbcb-a184-4aa6-8315-fce333d8a078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Volume f5adc36f-10c4-4847-8377-63fccc48fdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5adc36f-10c4-4847-8377-63fccc48fdc1', 'volume_size': 1}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:47 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:47 devstack sudo[107250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info
Sep 04 06:13:47 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:47 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:47 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info is being set with open permissions: ugo+rw
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:47 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info
Sep 04 06:13:47 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:47 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.info" returned: 0 in 0.270s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.744s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-548195547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5adc36f-10c4-4847-8377-63fccc48fdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6864493dad45998c0349cdb1210d11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:47Z,use_quota=True,user_id='4aa58cb4e8674c44b3a696f75fc3a4e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Creating volume f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:47 devstack sudo[107257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 1073741824
Sep 04 06:13:47 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5e8f052c-afee-4301-969f-6270ba3c4033 tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Flow 'volume_create_manager' (63170d16-6f4c-4f70-9be2-c71c955c7e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7549ce32-43ba-4598-9730-895496441b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7549ce32-43ba-4598-9730-895496441b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1129891688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200be31-a298-4f51-b88e-8912bd2abf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1910911188124690b87d5516d4df4afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:48Z,use_quota=True,user_id='d39450342ae24a10b7d30f39e1c05075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd49a69-d85b-403a-b726-aee36bed7a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd49a69-d85b-403a-b726-aee36bed7a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db6f3fe-2eaa-44d2-99b9-7a4e36b6c49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db6f3fe-2eaa-44d2-99b9-7a4e36b6c49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5200be31-a298-4f51-b88e-8912bd2abf0c', 'volume_name': 'volume-5200be31-a298-4f51-b88e-8912bd2abf0c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1621960f-00c9-4b51-b389-206dccc182ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1621960f-00c9-4b51-b389-206dccc182ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6193e99-4ca7-42df-8038-68567b994e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Volume 5200be31-a298-4f51-b88e-8912bd2abf0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5200be31-a298-4f51-b88e-8912bd2abf0c', 'volume_size': 1}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:48 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 1073741824" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:48 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1
Sep 04 06:13:48 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:48 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1" returned: 0 in 0.231s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1129891688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5200be31-a298-4f51-b88e-8912bd2abf0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1910911188124690b87d5516d4df4afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:48Z,use_quota=True,user_id='d39450342ae24a10b7d30f39e1c05075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Creating volume 5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:48 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:48 devstack sudo[107271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c 1073741824
Sep 04 06:13:48 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab7fbcb-a184-4aa6-8315-fce333d8a078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5adc36f-10c4-4847-8377-63fccc48fdc1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2286bd-f43f-4998-a935-579ef938110b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:48 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Volume volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 (f5adc36f-10c4-4847-8377-63fccc48fdc1): created successfully
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2286bd-f43f-4998-a935-579ef938110b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Flow 'volume_create_manager' (987b31f8-ba5e-45a6-ba42-694ff1208adc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-5a048f9b-ff6f-4893-9598-02d733815ff2 tempest-CinderUnicodeTest-206348574 None] Created volume successfully.
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-688cb70d-dd69-49fd-8f67-fd3a3725ab36-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-688cb70d-dd69-49fd-8f67-fd3a3725ab36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-688cb70d-dd69-49fd-8f67-fd3a3725ab36" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-688cb70d-dd69-49fd-8f67-fd3a3725ab36" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot 688cb70d-dd69-49fd-8f67-fd3a3725ab36 of volume d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9455bf-4e43-4f04-b67b-8ea2560686dd]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:48 devstack sudo[107276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36
Sep 04 06:13:48 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:49 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c 1073741824" returned: 0 in 0.469s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:49 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:13:49 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:49 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36" returned: 0 in 0.407s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e461c3-91a8-4313-be8e-ddf7870a4f4d]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:49 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6193e99-4ca7-42df-8038-68567b994e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5200be31-a298-4f51-b88e-8912bd2abf0c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615959d7-16e4-4bc9-a558-d633bb70d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:49 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Volume volume-5200be31-a298-4f51-b88e-8912bd2abf0c (5200be31-a298-4f51-b88e-8912bd2abf0c): created successfully
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (615959d7-16e4-4bc9-a558-d633bb70d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Flow 'volume_create_manager' (63170d16-6f4c-4f70-9be2-c71c955c7e4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:49 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96
Sep 04 06:13:49 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:49 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-379c09b7-712e-454f-a613-5d2b9bd45601 tempest-SnapshotDependencyTests-640761140 None] Created volume successfully.
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Creating offline snapshot ded6bf8d-d706-4612-a88b-3bf23c5c7e33 of volume f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3433de-17b5-43f7-a22c-a048bac2aeee]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:49 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1
Sep 04 06:13:49 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:49 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:49 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36
Sep 04 06:13:49 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:49 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1" returned: 0 in 0.363s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:49 devstack sudo[107299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 1G
Sep 04 06:13:49 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:50 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:50 devstack sudo[107302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36
Sep 04 06:13:50 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:50 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96.688cb70d-dd69-49fd-8f67-fd3a3725ab36" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:50 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 1G" returned: 0 in 0.495s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-688cb70d-dd69-49fd-8f67-fd3a3725ab36" released by "_delete_snapshot" :: held 1.616s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" released by "delete_snapshot" :: held 1.640s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:50 devstack sudo[107309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33
Sep 04 06:13:50 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Created reservations ['1c958155-3357-404b-9f80-0be42604e0c9', '1f4bdfa0-8413-46a4-bf46-e2c3a292b5e1', 'c31e40b1-ffd4-436f-bc24-5a2a9242bfa9', 'a1bc5e78-23e9-43ab-9bfc-45f27bd5837d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9bdf1b4b-5784-4573-aa1e-db6ac837892e tempest-ProjectMemberTests-12378103 None] Lock "cinder-688cb70d-dd69-49fd-8f67-fd3a3725ab36-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:50 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33" returned: 0 in 0.302s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 is being set with open permissions: ugo+rw
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:50 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33
Sep 04 06:13:50 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-d6e1eb13-3ac1-456c-81c3-b23947ac4a96-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:50 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33" returned: 0 in 0.273s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-d6e1eb13-3ac1-456c-81c3-b23947ac4a96-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:51 devstack sudo[107317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info
Sep 04 06:13:51 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69c2983-191a-457f-93b3-02879d21d1cc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:51 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96
Sep 04 06:13:51 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:51 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info" returned: 0 in 0.281s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:51 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info is being set with open permissions: ugo+rw
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:51 devstack sudo[107323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info
Sep 04 06:13:51 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:51 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:51 devstack sudo[107328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96
Sep 04 06:13:51 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:51 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.info" returned: 0 in 0.270s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.139s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.305s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Creating offline snapshot c31509c8-e958-45a1-8999-b248cc1989db of volume 5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:13:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-658a977f-5b6e-4798-9226-109f30324171 tempest-CinderUnicodeTest-206348574 None] Create snapshot completed successfully
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d41eac-a7ee-4c14-865e-d15ac537d881]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:51 devstack sudo[107331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:13:51 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:51 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-d6e1eb13-3ac1-456c-81c3-b23947ac4a96" released by "delete_volume" :: held 0.741s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Created reservations ['8df35c48-2e63-47e9-af9f-726f57e9e77c', '650f43b2-8bef-4bcb-ba16-519b7a2e0c33', '962a83e3-b097-43de-a889-376788de524e', '1cc4dabe-5fd9-456c-b140-16b83cf29726'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:52 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:52 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:52 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:52 devstack sudo[107339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db 1G
Sep 04 06:13:52 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:52 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:52 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-2718a98f-5198-41b1-8f84-9adfda3fcea5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-d6e1eb13-3ac1-456c-81c3-b23947ac4a96-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:52 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db 1G" returned: 0 in 0.504s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5200be31-a298-4f51-b88e-8912bd2abf0c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:52 devstack sudo[107345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5200be31-a298-4f51-b88e-8912bd2abf0c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:13:52 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (060e1dc7-e589-455f-9620-0c8a026153a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8743869d-6816-4a95-8429-f5641f79f60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-ded6bf8d-d706-4612-a88b-3bf23c5c7e33-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8743869d-6816-4a95-8429-f5641f79f60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744605540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4f44dd-0ade-4a50-9546-a24282ba4cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:53Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f4ed7e-5d6d-4428-a645-bbaa5cb076a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83f4ed7e-5d6d-4428-a645-bbaa5cb076a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fd28dc-c959-47d2-b162-320c933d8679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41fd28dc-c959-47d2-b162-320c933d8679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e4f44dd-0ade-4a50-9546-a24282ba4cb2', 'volume_name': 'volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f69e19-5d89-40af-bd19-36c4939a8245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f69e19-5d89-40af-bd19-36c4939a8245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e18524-8005-499c-a4b8-0b2d25a124fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:52 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Volume 1e4f44dd-0ade-4a50-9546-a24282ba4cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2', 'volume_size': 1}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-ded6bf8d-d706-4612-a88b-3bf23c5c7e33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-quobyte-ded6bf8d-d706-4612-a88b-3bf23c5c7e33" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-ded6bf8d-d706-4612-a88b-3bf23c5c7e33" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Deleting offline snapshot ded6bf8d-d706-4612-a88b-3bf23c5c7e33 of volume f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] snapshot_file for this snap is: volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[276c1d18-faa1-400f-a0a4-63e8213ef950]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:52 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5200be31-a298-4f51-b88e-8912bd2abf0c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:52 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db is being set with open permissions: ugo+rw
Sep 04 06:13:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:52 devstack sudo[107351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:13:52 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:52 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33
Sep 04 06:13:53 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:53 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33" returned: 0 in 0.391s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5adc36f-10c4-4847-8377-63fccc48fdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:53 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info
Sep 04 06:13:53 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fec6c6-8ef7-4e89-a359-886295c4b9d3]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:53 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1
Sep 04 06:13:53 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:53 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info is being set with open permissions: ugo+rw
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:53 devstack sudo[107363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info
Sep 04 06:13:53 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:53 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33
Sep 04 06:13:53 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.info" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.174s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.045s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1744605540',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e4f44dd-0ade-4a50-9546-a24282ba4cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:53Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Creating volume 1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:53 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:13:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:53 devstack sudo[107371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 1073741824
Sep 04 06:13:53 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:53 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c5e9fb89-72ac-49fe-9159-a6d05425860b tempest-SnapshotDependencyTests-640761140 None] Create snapshot completed successfully
Sep 04 06:13:54 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33" returned: 0 in 0.347s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:54 devstack sudo[107376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33
Sep 04 06:13:54 devstack sudo[107376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:54 devstack sudo[107376]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1.ded6bf8d-d706-4612-a88b-3bf23c5c7e33" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:54 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 1073741824" returned: 0 in 0.487s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-ded6bf8d-d706-4612-a88b-3bf23c5c7e33" released by "_delete_snapshot" :: held 1.509s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" released by "delete_snapshot" :: held 1.534s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:54 devstack sudo[107382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2
Sep 04 06:13:54 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Created reservations ['1ae240cb-900a-490c-ba67-41600b6a3554', '5b34bfd2-3ace-409d-9163-d641b537f505', 'faecd6ef-df44-4f14-b84f-9ba09a9a4c01', 'b32abe8d-209a-4d10-b9be-3bc5419428c0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Delete snapshot completed successfully.
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-444a77ee-c202-49b1-86a5-74e2193d425a tempest-CinderUnicodeTest-206348574 None] Lock "cinder-ded6bf8d-d706-4612-a88b-3bf23c5c7e33-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:54 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e18524-8005-499c-a4b8-0b2d25a124fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c5dd70-c935-4ba3-8fe7-81449791f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:54 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Volume volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 (1e4f44dd-0ade-4a50-9546-a24282ba4cb2): created successfully
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c5dd70-c935-4ba3-8fe7-81449791f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (060e1dc7-e589-455f-9620-0c8a026153a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fdc6d7d4-721c-4f83-a16b-6330d46daccd tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-f5adc36f-10c4-4847-8377-63fccc48fdc1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "cinder-f5adc36f-10c4-4847-8377-63fccc48fdc1-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[088a3b48-88ac-4970-8d1e-a7596db7e8d8]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:55 devstack sudo[107385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1
Sep 04 06:13:55 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Flow 'volume_create_manager' (f1722431-a7ad-4536-b1f7-1d64f5ca16cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a9fd76-3778-4b3c-96ba-36c23f9c455f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20a9fd76-3778-4b3c-96ba-36c23f9c455f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:13:55Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00f052f-e9d8-4e9e-9967-a2f3ac33ea95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1910911188124690b87d5516d4df4afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c31509c8-e958-45a1-8999-b248cc1989db,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:13:55Z,use_quota=True,user_id='d39450342ae24a10b7d30f39e1c05075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0208f1c9-0dae-4d1e-ace6-0990cd58c7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0208f1c9-0dae-4d1e-ace6-0990cd58c7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d946717-c300-4dbb-979d-b8c352f23343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d946717-c300-4dbb-979d-b8c352f23343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e00f052f-e9d8-4e9e-9967-a2f3ac33ea95', 'volume_name': 'volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95', 'volume_size': 1, 'snapshot_id': 'c31509c8-e958-45a1-8999-b248cc1989db'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a102871-3bc3-498f-b52a-0861fab76c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a102871-3bc3-498f-b52a-0861fab76c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70434da5-5d81-483d-a35d-499f0e21c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:13:55 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Volume e00f052f-e9d8-4e9e-9967-a2f3ac33ea95: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95', 'volume_size': 1, 'snapshot_id': 'c31509c8-e958-45a1-8999-b248cc1989db'}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" by "_create_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Creating volume e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 from snapshot c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" by "_copy_volume_from_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] snapshot: c31509c8-e958-45a1-8999-b248cc1989db, volume: e00f052f-e9d8-4e9e-9967-a2f3ac33ea95,  {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef0ec6f-16d3-4efe-ba7b-61156202c324]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:55 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1" returned: 0 in 0.371s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:55 devstack sudo[107391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1
Sep 04 06:13:55 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:55 devstack sudo[107390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:13:55 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:55 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f5adc36f-10c4-4847-8377-63fccc48fdc1" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-f5adc36f-10c4-4847-8377-63fccc48fdc1" released by "delete_volume" :: held 0.678s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Created reservations ['2733f714-d0d1-425a-a0a6-ce72f8c02d4c', '68e8cb5e-118e-4c02-8886-aa8ea4614226', '884f7ae3-7a43-4b16-b179-dd1b16c06a04', '2bbb786d-94f9-4b15-8118-02bb662d93b3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:55 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.379s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5200be31-a298-4f51-b88e-8912bd2abf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931b43d-c8ca-42ee-a538-59f1494f2ff5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:55 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:55 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:55 devstack sudo[107399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:13:55 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-b569ac87-c494-4c2b-b797-2c3087b168ff-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "cinder-b569ac87-c494-4c2b-b797-2c3087b168ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:56 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.331s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:56 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Deleted volume successfully.
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "cinder-quobyte-b569ac87-c494-4c2b-b797-2c3087b168ff" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:13:56 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0d6a3393-6bf2-4744-9661-f66dfa93a5ef tempest-CinderUnicodeTest-206348574 None] Lock "cinder-f5adc36f-10c4-4847-8377-63fccc48fdc1-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.432s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Creating direct copy from snapshot {{(pid=87095) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.utils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Path /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 not found in is_blk_device check {{(pid=87095) is_blk_device /opt/stack/cinder/cinder/utils.py:622}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-b569ac87-c494-4c2b-b797-2c3087b168ff" acquired by "delete_volume" :: waited 0.041s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:13:56 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95
Sep 04 06:13:56 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d210beb3-2f94-487c-8508-5b785f563870]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:56 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff
Sep 04 06:13:56 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:56 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:56 devstack sudo[107417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff
Sep 04 06:13:56 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:57 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-b569ac87-c494-4c2b-b797-2c3087b168ff" returned: 0 in 0.548s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "cinder-quobyte-b569ac87-c494-4c2b-b797-2c3087b168ff" released by "delete_volume" :: held 0.975s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Created reservations ['4ac9653f-c068-49b6-b4e9-f0d447d9af69', '5c6fc798-cc04-44b8-87d7-08a095843a3b', '3fbfc95e-363c-4688-9844-b3acc2fd5946', '93a45e44-9fb5-4444-8792-bfe9dc104372'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:13:57 devstack sudo[107427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:13:57 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:13:57 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root
Sep 04 06:13:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.421s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:13:58 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:13:58 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Deleted volume successfully.
Sep 04 06:13:58 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f1cf9e5-5d16-457e-b093-4ad6542d8725 tempest-CinderUnicodeTest-206348574 None] Lock "cinder-b569ac87-c494-4c2b-b797-2c3087b168ff-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:01 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" returned: 0 in 4.856s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.image.image_utils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Image conversion details: src /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c, size 1024.00 MB, duration 4.86 sec, destination /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 {{(pid=87095) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Sep 04 06:14:01 devstack cinder-volume[87095]: INFO cinder.image.image_utils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Converted 1024.00 MB image at 210.84 MB/s
Sep 04 06:14:01 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 is being set with open permissions: ugo+rw
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:01 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95
Sep 04 06:14:01 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:01 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" released by "_copy_volume_from_snapshot" :: held 6.032s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" released by "_create_volume_from_snapshot" :: held 6.129s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.151s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.428s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Creating offline snapshot 0df9852d-b490-407e-97d0-e9a68d5ebc31 of volume 1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[702b2c01-dade-415f-8930-2856fd183a93]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70434da5-5d81-483d-a35d-499f0e21c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95', 'volume_size': 1, 'snapshot_id': 'c31509c8-e958-45a1-8999-b248cc1989db'}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaec278-e3ef-4118-8d17-3dd394bc9517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:01 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Volume volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 (e00f052f-e9d8-4e9e-9967-a2f3ac33ea95): created successfully
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eaec278-e3ef-4118-8d17-3dd394bc9517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Flow 'volume_create_manager' (f1722431-a7ad-4536-b1f7-1d64f5ca16cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:01 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ff19a5d5-8f5d-4603-baae-32c13e60db7e tempest-SnapshotDependencyTests-640761140 None] Created volume successfully.
Sep 04 06:14:01 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2
Sep 04 06:14:01 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-c31509c8-e958-45a1-8999-b248cc1989db-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-c31509c8-e958-45a1-8999-b248cc1989db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Deleting offline snapshot c31509c8-e958-45a1-8999-b248cc1989db of volume 5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] snapshot_file for this snap is: volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af5ad6e-85e7-490e-96ce-66b573038f5e]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:01 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:01 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:02 devstack sudo[107441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 1G
Sep 04 06:14:02 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:02 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:14:02 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:02 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.446s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5200be31-a298-4f51-b88e-8912bd2abf0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[be316932-c979-4fc2-9065-c3997fe5aedc]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:02 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 1G" returned: 0 in 0.472s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:02 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31
Sep 04 06:14:02 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:02 devstack sudo[107452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:14:02 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:02 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:02 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 is being set with open permissions: ugo+rw
Sep 04 06:14:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:02 devstack sudo[107462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31
Sep 04 06:14:02 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:03 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.618s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:03 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:03 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info
Sep 04 06:14:03 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:03 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info is being set with open permissions: ugo+rw
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:03 devstack sudo[107475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info
Sep 04 06:14:03 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:03 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:03 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db
Sep 04 06:14:03 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:03 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.info" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:03 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c.c31509c8-e958-45a1-8999-b248cc1989db" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f88c468f-e858-4f10-9321-dd5590e414ae tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-c31509c8-e958-45a1-8999-b248cc1989db" released by "_delete_snapshot" :: held 1.861s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" released by "delete_snapshot" :: held 1.886s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Created reservations ['794045d7-bfd8-4c42-a6f5-7f200f806a30', '4e863833-4123-43fd-a91d-86bb362de9a3', 'fa656fc9-e857-472b-9942-de71bc2eb2e4', 'f89347d0-a7dd-4966-97a2-e7b6028c11e8'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Delete snapshot completed successfully.
Sep 04 06:14:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-845e859f-a02a-41fe-865f-ea73c4a218fb tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-c31509c8-e958-45a1-8999-b248cc1989db-delete_snapshot" released by "delete_snapshot" :: held 2.063s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-5200be31-a298-4f51-b88e-8912bd2abf0c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-5200be31-a298-4f51-b88e-8912bd2abf0c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[274b43aa-a489-4d87-b014-f154d7cc8658]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:04 devstack sudo[107481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:14:04 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-0df9852d-b490-407e-97d0-e9a68d5ebc31-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-0df9852d-b490-407e-97d0-e9a68d5ebc31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-0df9852d-b490-407e-97d0-e9a68d5ebc31" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:04 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-0df9852d-b490-407e-97d0-e9a68d5ebc31" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:04 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c
Sep 04 06:14:04 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot 0df9852d-b490-407e-97d0-e9a68d5ebc31 of volume 1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[79461f74-c00e-4405-a48e-ca46bc75d039]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:04 devstack sudo[107488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31
Sep 04 06:14:04 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:04 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5200be31-a298-4f51-b88e-8912bd2abf0c" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-5200be31-a298-4f51-b88e-8912bd2abf0c" released by "delete_volume" :: held 0.767s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Created reservations ['e11e48cc-f40f-4a9b-877b-44c2c27998cc', 'fd4cbf9a-3826-4989-9996-c50802c6304e', 'b79b5c9d-8516-4ad0-85fc-5dd6123ffd33', '6ee53eaf-658e-4511-b192-c98d5b66de4a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:05 devstack sudo[107493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:05 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:05 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9af0b7-c525-4206-aea4-1fef5db462c6]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:05 devstack sudo[107496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2
Sep 04 06:14:05 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:05 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.339s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Deleted volume successfully.
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" acquired by "delete_volume" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa12633e-5683-44da-b6f6-a40aba3df3b0]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-9d51ea63-9a20-4abc-93bf-5d1b82cfb4b9 tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-5200be31-a298-4f51-b88e-8912bd2abf0c-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:05 devstack sudo[107499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95
Sep 04 06:14:05 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:05 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" returned: 0 in 0.496s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:05 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31
Sep 04 06:14:05 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:05 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" returned: 0 in 0.450s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:05 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95
Sep 04 06:14:05 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:06 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31" returned: 0 in 0.437s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:06 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31
Sep 04 06:14:06 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:06 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-quobyte-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95" released by "delete_volume" :: held 0.840s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Created reservations ['06e0af02-0593-49e9-86e9-4fcf4bf15e48', 'be6fc092-3233-444e-95f3-e903acbf4adc', '8948de2e-c5c0-49f8-8be7-df443326f00d', '40baff79-f36c-4390-a34b-2a94e35f1e2f'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:06 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2.0df9852d-b490-407e-97d0-e9a68d5ebc31" returned: 0 in 0.320s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-0df9852d-b490-407e-97d0-e9a68d5ebc31" released by "_delete_snapshot" :: held 1.815s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" released by "delete_snapshot" :: held 1.863s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:06 devstack sudo[107519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:06 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Created reservations ['b47fe276-e0f8-41f0-b827-b99e4d5dac12', 'fee08ae9-d453-4a7f-9e36-70b8c46b4048', '96b00fae-a328-4a26-a4f5-bfa0bef5fb79', '651e311e-3815-4fc4-be7d-484dd04f2f9c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-514d53a3-979d-4220-b941-f482e179bbcb tempest-ProjectMemberTests-12378103 None] Lock "cinder-0df9852d-b490-407e-97d0-e9a68d5ebc31-delete_snapshot" released by "delete_snapshot" :: held 2.128s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:06 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.308s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:06 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Deleted volume successfully.
Sep 04 06:14:06 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-51ce915f-249e-4b46-8289-0ea986e000ef tempest-SnapshotDependencyTests-640761140 None] Lock "cinder-e00f052f-e9d8-4e9e-9967-a2f3ac33ea95-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-1e4f44dd-0ade-4a50-9546-a24282ba4cb2-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "cinder-1e4f44dd-0ade-4a50-9546-a24282ba4cb2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b10e77-dc15-48bb-9cdd-1f815cf11b5a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:07 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:08 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2
Sep 04 06:14:08 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:08 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" returned: 0 in 0.438s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:08 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2
Sep 04 06:14:08 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:08 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-1e4f44dd-0ade-4a50-9546-a24282ba4cb2" released by "delete_volume" :: held 0.808s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Created reservations ['89bb1a15-1582-401a-afd2-2b78ba759aef', '677b3e1c-d68e-40d5-bce9-2786645a8de3', '1df73f89-96fd-49e9-b65a-0083a136178d', 'a42b58ee-de85-4cba-b19b-1c40e04c1e31'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:08 devstack sudo[107531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:08 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (c6336497-5b42-46b4-a963-fbb373cfb3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:08 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6953b3b-3e93-46b3-84f9-d82f57ba135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6953b3b-3e93-46b3-84f9-d82f57ba135a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28896836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61689a4f-e217-4104-8a09-3c7f5329588a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:09Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b88442-89d6-47f7-b63d-5dc172bc6bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b88442-89d6-47f7-b63d-5dc172bc6bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c8bed4-5b83-4a46-876a-130797048ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c8bed4-5b83-4a46-876a-130797048ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61689a4f-e217-4104-8a09-3c7f5329588a', 'volume_name': 'volume-61689a4f-e217-4104-8a09-3c7f5329588a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d894b4a-b10e-45a5-9a68-cc819c13ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d894b4a-b10e-45a5-9a68-cc819c13ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7862e6ce-730d-41cc-9e0c-214e0ec1aa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Volume 61689a4f-e217-4104-8a09-3c7f5329588a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61689a4f-e217-4104-8a09-3c7f5329588a', 'volume_size': 1}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-28896836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61689a4f-e217-4104-8a09-3c7f5329588a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:09Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Creating volume 61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:09 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a 1073741824
Sep 04 06:14:09 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:09 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:09 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7df7e1eb-7aa6-47eb-81d6-55764684cc8c tempest-ProjectMemberTests-12378103 None] Lock "cinder-1e4f44dd-0ade-4a50-9546-a24282ba4cb2-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (9374cb92-5ad7-45d3-893a-eabcaf1aecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25ad3e-348b-47c6-a244-6266679d0339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb25ad3e-348b-47c6-a244-6266679d0339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278710919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102d01ad-423b-40f3-b607-1e72b7d2b47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:10Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb7a400-d26f-43c1-9ba5-2c9180b39b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb7a400-d26f-43c1-9ba5-2c9180b39b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405a0894-a519-493b-a0be-11450a12b506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (405a0894-a519-493b-a0be-11450a12b506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '102d01ad-423b-40f3-b607-1e72b7d2b47c', 'volume_name': 'volume-102d01ad-423b-40f3-b607-1e72b7d2b47c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9488fb-ffb1-4ec8-a79b-c0c20a4dd13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db9488fb-ffb1-4ec8-a79b-c0c20a4dd13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8368706b-69a1-4f66-afb0-61ee385af55b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:09 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Volume 102d01ad-423b-40f3-b607-1e72b7d2b47c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-102d01ad-423b-40f3-b607-1e72b7d2b47c', 'volume_size': 1}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:09 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a 1073741824" returned: 0 in 0.613s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:09 devstack sudo[107541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a
Sep 04 06:14:09 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:09 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.281s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-278710919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=102d01ad-423b-40f3-b607-1e72b7d2b47c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:10Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Creating volume 102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:09 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7862e6ce-730d-41cc-9e0c-214e0ec1aa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61689a4f-e217-4104-8a09-3c7f5329588a', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:09 devstack sudo[107544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c 1073741824
Sep 04 06:14:09 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:09 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129ae66-5c6a-4e0c-be89-431114b64f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Volume volume-61689a4f-e217-4104-8a09-3c7f5329588a (61689a4f-e217-4104-8a09-3c7f5329588a): created successfully
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a129ae66-5c6a-4e0c-be89-431114b64f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (c6336497-5b42-46b4-a963-fbb373cfb3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1db690b2-6179-4268-8511-053bda10a2bf tempest-ProjectReaderTests-1299980927 None] Created volume successfully.
Sep 04 06:14:10 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c 1073741824" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:10 devstack sudo[107549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c
Sep 04 06:14:10 devstack sudo[107549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:10 devstack sudo[107549]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c" returned: 0 in 0.284s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8368706b-69a1-4f66-afb0-61ee385af55b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-102d01ad-423b-40f3-b607-1e72b7d2b47c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc83bc1-7de0-47ee-8cda-1ce5e833db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:10 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Volume volume-102d01ad-423b-40f3-b607-1e72b7d2b47c (102d01ad-423b-40f3-b607-1e72b7d2b47c): created successfully
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfc83bc1-7de0-47ee-8cda-1ce5e833db4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:10 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (9374cb92-5ad7-45d3-893a-eabcaf1aecc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:10 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f056604e-fbe6-41fc-8788-c126ce833f56 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Creating offline snapshot d92e5ac2-c3f9-4f8b-b022-278844068439 of volume 61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[2390baeb-c2df-4eb8-8d89-25332de6a892]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:11 devstack sudo[107554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a
Sep 04 06:14:11 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:11 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a" returned: 0 in 0.464s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:11 devstack sudo[107560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 1G
Sep 04 06:14:11 devstack sudo[107560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:11 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:12 devstack sudo[107560]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 1G" returned: 0 in 0.452s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61689a4f-e217-4104-8a09-3c7f5329588a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:12 devstack sudo[107568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61689a4f-e217-4104-8a09-3c7f5329588a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439
Sep 04 06:14:12 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:12 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61689a4f-e217-4104-8a09-3c7f5329588a -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439" returned: 0 in 0.328s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:12 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 is being set with open permissions: ugo+rw
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:12 devstack sudo[107573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439
Sep 04 06:14:12 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:12 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:12 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:12 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:12 devstack sudo[107578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info
Sep 04 06:14:12 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:12 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.318s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:14:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:14:13 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info" returned: 0 in 0.297s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:13 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info is being set with open permissions: ugo+rw
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:13 devstack sudo[107583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info
Sep 04 06:14:13 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:13 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.info" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.191s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.521s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Creating offline snapshot f53a6617-36df-49ac-a054-6f723f7570c3 of volume 102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:13 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-fcf9987f-086b-49bf-b71c-2d38b56a417e tempest-ProjectReaderTests-1299980927 None] Create snapshot completed successfully
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0051fa8-f7ea-4d68-8188-3064194a1381]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:13 devstack sudo[107586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c
Sep 04 06:14:13 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:13 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c" returned: 0 in 0.417s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:13 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:13 devstack sudo[107591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 1G
Sep 04 06:14:13 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:14 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 1G" returned: 0 in 0.531s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102d01ad-423b-40f3-b607-1e72b7d2b47c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:14 devstack sudo[107597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102d01ad-423b-40f3-b607-1e72b7d2b47c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3
Sep 04 06:14:14 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-d92e5ac2-c3f9-4f8b-b022-278844068439-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-d92e5ac2-c3f9-4f8b-b022-278844068439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-d92e5ac2-c3f9-4f8b-b022-278844068439" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-d92e5ac2-c3f9-4f8b-b022-278844068439" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Deleting offline snapshot d92e5ac2-c3f9-4f8b-b022-278844068439 of volume 61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] snapshot_file for this snap is: volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[50093b88-2afb-4c98-9ee6-f62cd3030a57]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:14 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-102d01ad-423b-40f3-b607-1e72b7d2b47c -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:14 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 is being set with open permissions: ugo+rw
Sep 04 06:14:14 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:14 devstack sudo[107603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3
Sep 04 06:14:14 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:14 devstack sudo[107602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439
Sep 04 06:14:14 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:15 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3" returned: 0 in 0.268s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:15 devstack sudo[107610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info
Sep 04 06:14:15 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:15 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439" returned: 0 in 0.386s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61689a4f-e217-4104-8a09-3c7f5329588a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec311e9-81b2-4f0d-ae4b-aea1b64fd4ee]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:15 devstack sudo[107612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a
Sep 04 06:14:15 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:15 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:15 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info is being set with open permissions: ugo+rw
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:15 devstack sudo[107615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info
Sep 04 06:14:15 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:15 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a" returned: 0 in 0.475s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:15 devstack sudo[107621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439
Sep 04 06:14:15 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:15 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.info" returned: 0 in 0.323s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:15 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.299s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:15 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-84a1242a-3b54-41c2-b63a-2bbe6b86f29a tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:16 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439" returned: 0 in 0.385s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:16 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439
Sep 04 06:14:16 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-f53a6617-36df-49ac-a054-6f723f7570c3-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-f53a6617-36df-49ac-a054-6f723f7570c3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-f53a6617-36df-49ac-a054-6f723f7570c3" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f53a6617-36df-49ac-a054-6f723f7570c3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot f53a6617-36df-49ac-a054-6f723f7570c3 of volume 102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdc4e0c-0754-48ee-bb92-fa8ff593e405]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a.d92e5ac2-c3f9-4f8b-b022-278844068439" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:16 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:16 devstack sudo[107628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3
Sep 04 06:14:16 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-d92e5ac2-c3f9-4f8b-b022-278844068439" released by "_delete_snapshot" :: held 1.664s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" released by "delete_snapshot" :: held 1.712s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Created reservations ['fe871d0d-b01a-45c6-a26e-14ba470d4143', 'bad0ba12-1bd6-46cd-9879-b9476e31f568', '0985a2f1-ffaf-4e83-a58d-3a490f87e6d6', 'e2c0161a-69b8-4d3f-9460-b2a119ed1581'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:16 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Delete snapshot completed successfully.
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-11125bcf-9202-4410-b1e7-bc486dca7f2e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-d92e5ac2-c3f9-4f8b-b022-278844068439-delete_snapshot" released by "delete_snapshot" :: held 1.924s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:16 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3" returned: 0 in 0.468s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-102d01ad-423b-40f3-b607-1e72b7d2b47c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26960c7-3be3-4439-b0b8-cbd4f8487293]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-61689a4f-e217-4104-8a09-3c7f5329588a-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:16 devstack sudo[107635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c
Sep 04 06:14:16 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-61689a4f-e217-4104-8a09-3c7f5329588a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb95056-a862-4f10-8e25-dfbdab982097]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:16 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:17 devstack sudo[107637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a
Sep 04 06:14:17 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:17 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c" returned: 0 in 0.435s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:17 devstack sudo[107642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3
Sep 04 06:14:17 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:17 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:17 devstack sudo[107649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a
Sep 04 06:14:17 devstack sudo[107649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:17 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3" returned: 0 in 0.430s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:17 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3
Sep 04 06:14:17 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:17 devstack sudo[107649]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-61689a4f-e217-4104-8a09-3c7f5329588a" returned: 0 in 0.300s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-61689a4f-e217-4104-8a09-3c7f5329588a" released by "delete_volume" :: held 0.763s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Created reservations ['e1978f14-7902-4c1a-b8e9-accc436c3287', 'c75249c8-ef77-4536-97c0-af2cbb7891c4', 'd0112ac2-b037-4661-8ac7-2c0d9a3ea5ec', '30769aed-5c1c-4120-b3d6-f58f859d8926'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:17 devstack sudo[107656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:17 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:17 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c.f53a6617-36df-49ac-a054-6f723f7570c3" returned: 0 in 0.276s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f53a6617-36df-49ac-a054-6f723f7570c3" released by "_delete_snapshot" :: held 1.731s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" released by "delete_snapshot" :: held 1.758s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:17 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Created reservations ['44053c2e-851a-4927-a2bc-6d98d886f0ee', 'adcabf2d-e750-4f4f-beeb-c54ca52cb444', '53dcb9f4-250d-4498-99de-ba40f11c9cf8', '248f3ac8-ffec-4206-8285-56064c0c2023'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-85185a63-e7ae-4bf3-9f8a-aad7b4188f2a tempest-ProjectMemberTests-12378103 None] Lock "cinder-f53a6617-36df-49ac-a054-6f723f7570c3-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:18 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.307s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:18 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Deleted volume successfully.
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-24383789-87d0-4ccc-a1e3-038341121ca5 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-61689a4f-e217-4104-8a09-3c7f5329588a-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-102d01ad-423b-40f3-b607-1e72b7d2b47c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "cinder-102d01ad-423b-40f3-b607-1e72b7d2b47c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" acquired by "delete_volume" :: waited 0.031s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c35b55-c283-481e-8ce9-64cf8dde0eca]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (a0c42a3b-8aac-4b6e-8d59-caedabdad058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74bf206-0ecc-4f05-8b68-30bdd5284b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:18 devstack sudo[107659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c
Sep 04 06:14:18 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74bf206-0ecc-4f05-8b68-30bdd5284b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108136902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:19Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f602128e-21d7-40b3-a35a-e05b6be0b752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f602128e-21d7-40b3-a35a-e05b6be0b752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0b0ff2-b7db-4006-bb38-ba92ef28b205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df0b0ff2-b7db-4006-bb38-ba92ef28b205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f', 'volume_name': 'volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5bd9bb-5e0f-4e91-a0ec-3fce3b2cdd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5bd9bb-5e0f-4e91-a0ec-3fce3b2cdd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57749a4c-6357-408e-ab9f-20ee1718288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:18 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Volume ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f', 'volume_size': 1}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108136902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:19Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Creating volume ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:18 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:18 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f 1073741824
Sep 04 06:14:18 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:18 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:18 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:18 devstack sudo[107666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c
Sep 04 06:14:18 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:19 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f 1073741824" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:19 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-102d01ad-423b-40f3-b607-1e72b7d2b47c" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:19 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f
Sep 04 06:14:19 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-102d01ad-423b-40f3-b607-1e72b7d2b47c" released by "delete_volume" :: held 0.754s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Created reservations ['646c2257-6d79-4f42-866a-971dfc41515d', '8a1acafa-a42f-4b8d-afbc-39be01b1406d', 'fd9d66c8-a8fe-498f-82b0-544b4fc3f781', 'e5433017-7dab-4e2d-9fba-288fe20aaebb'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:19 devstack sudo[107675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:19 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:19 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" returned: 0 in 0.241s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57749a4c-6357-408e-ab9f-20ee1718288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361a15b3-a300-4094-8c85-2a25d0501ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:19 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Volume volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f (ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f): created successfully
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (361a15b3-a300-4094-8c85-2a25d0501ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (a0c42a3b-8aac-4b6e-8d59-caedabdad058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-813b4e5f-1038-470a-8e9b-fd6d317da044 tempest-ProjectReaderTests-1299980927 None] Created volume successfully.
Sep 04 06:14:19 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:19 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-e649a05f-4c96-4790-bcb6-c002af30a24b tempest-ProjectMemberTests-12378103 None] Lock "cinder-102d01ad-423b-40f3-b607-1e72b7d2b47c-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Creating offline snapshot 5a670f89-3283-4180-9846-192f60efd2ff of volume ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[af89d312-1311-4ab5-bc26-4cf22b0f8918]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:19 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:19 devstack sudo[107679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f
Sep 04 06:14:19 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (a281f4b1-6396-46f4-b7cd-3d41a839a8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3508a5-8d23-4e8c-ab27-4a007b7a3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3508a5-8d23-4e8c-ab27-4a007b7a3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064045256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6289ec-3771-43b3-b2c7-4aa6b43af317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:20Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db92def5-0bc8-4dcd-ab1d-77bf41b30716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db92def5-0bc8-4dcd-ab1d-77bf41b30716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0865fa-13e0-43d2-8233-995f80d134c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0865fa-13e0-43d2-8233-995f80d134c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6289ec-3771-43b3-b2c7-4aa6b43af317', 'volume_name': 'volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264b429c-fe0e-4640-905f-49cb0d461ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264b429c-fe0e-4640-905f-49cb0d461ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a3f724-28a8-45aa-a45c-9057ece8bd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:20 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Volume 9c6289ec-3771-43b3-b2c7-4aa6b43af317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317', 'volume_size': 1}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:20 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" returned: 0 in 0.384s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:20 devstack sudo[107684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff 1G
Sep 04 06:14:20 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:20 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff 1G" returned: 0 in 0.398s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:20 devstack sudo[107689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff
Sep 04 06:14:20 devstack sudo[107689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:20 devstack sudo[107689]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:20 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff is being set with open permissions: ugo+rw
Sep 04 06:14:20 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:20 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff
Sep 04 06:14:20 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:21 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:21 devstack sudo[107697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info
Sep 04 06:14:21 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:21 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:21 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info is being set with open permissions: ugo+rw
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:21 devstack sudo[107701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info
Sep 04 06:14:21 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:21 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.info" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.510s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2064045256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6289ec-3771-43b3-b2c7-4aa6b43af317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:20Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Creating volume 9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:21 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:21 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 1073741824
Sep 04 06:14:21 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:21 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c9e768c3-c3d8-40a2-84e8-be55fd6e8000 tempest-ProjectReaderTests-1299980927 None] Create snapshot completed successfully
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-5a670f89-3283-4180-9846-192f60efd2ff-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-5a670f89-3283-4180-9846-192f60efd2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-5a670f89-3283-4180-9846-192f60efd2ff" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5a670f89-3283-4180-9846-192f60efd2ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Deleting offline snapshot 5a670f89-3283-4180-9846-192f60efd2ff of volume ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:21 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] snapshot_file for this snap is: volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d5d768-e12c-458f-ae5d-37d56ccadfd9]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:22 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff
Sep 04 06:14:22 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:22 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 1073741824" returned: 0 in 0.473s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:22 devstack sudo[107712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317
Sep 04 06:14:22 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:22 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff" returned: 0 in 0.389s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49905ad-c73a-4dfd-9119-4f1b346c5188]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:22 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317" returned: 0 in 0.262s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a3f724-28a8-45aa-a45c-9057ece8bd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666417c5-9f06-40a4-8c77-f791085c838b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:22 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Volume volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 (9c6289ec-3771-43b3-b2c7-4aa6b43af317): created successfully
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (666417c5-9f06-40a4-8c77-f791085c838b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (a281f4b1-6396-46f4-b7cd-3d41a839a8b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:22 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a629e90b-f8fa-44fb-a40f-584f0a5554c3 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:22 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f
Sep 04 06:14:22 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:22 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" returned: 0 in 0.349s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:22 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:22 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff
Sep 04 06:14:22 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:23 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff" returned: 0 in 0.334s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:23 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff
Sep 04 06:14:23 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Creating offline snapshot a1d61906-e089-4377-aa6c-0cc2213b1d28 of volume 9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:23 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f.5a670f89-3283-4180-9846-192f60efd2ff" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec8df88-23b2-4261-b592-dd2295ffec7a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5a670f89-3283-4180-9846-192f60efd2ff" released by "_delete_snapshot" :: held 1.471s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" released by "delete_snapshot" :: held 1.498s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Created reservations ['e035313a-7188-4d38-a391-1319f08b8df7', '2fb149b3-4099-4ada-9ba7-aaa5ea9f1186', '88d600e8-9a0f-4531-9092-8fad9a3f4a65', '5a911a19-f50e-4a4e-9609-815ac1450857'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:23 devstack sudo[107731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317
Sep 04 06:14:23 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:23 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Delete snapshot completed successfully.
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-8bdf5380-8e8f-4c32-991f-836a53f6d140 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-5a670f89-3283-4180-9846-192f60efd2ff-delete_snapshot" released by "delete_snapshot" :: held 1.643s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:23 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:23 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:23 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 1G
Sep 04 06:14:23 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ffa046-1176-40eb-9c72-69c5a86aa7fb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:24 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 1G" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:24 devstack sudo[107743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28
Sep 04 06:14:24 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack sudo[107742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f
Sep 04 06:14:24 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28" returned: 0 in 0.348s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:24 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 is being set with open permissions: ugo+rw
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:24 devstack sudo[107752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28
Sep 04 06:14:24 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" returned: 0 in 0.445s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:24 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f
Sep 04 06:14:24 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:24 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info
Sep 04 06:14:24 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:24 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:24 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f" released by "delete_volume" :: held 0.784s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Created reservations ['e111bdbe-c69e-4d6c-ba93-319a21a29ecb', 'a5c5a9d9-0bcc-4f04-8876-4a215f492b48', 'bf35ed28-8ffa-4cd9-b564-8dd0a8b8f4a7', 'e84a1d3e-cf7c-46cb-a128-0cbdbcccd5e0'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:25 devstack sudo[107761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:25 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:25 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:25 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info is being set with open permissions: ugo+rw
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:25 devstack sudo[107764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info
Sep 04 06:14:25 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:25 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Deleted volume successfully.
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-81e82945-b805-4d03-bbe6-eaf1c025e354 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-ee76599a-e89d-4cac-bd0a-ed29e1d4ee1f-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:25 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.info" returned: 0 in 0.289s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.130s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:25 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-11c9dfac-c4ef-45c2-beae-dbace39a0c4c tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (d49d1346-c105-41bc-a6c3-396170dd3fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeee4d6c-59cd-44a9-86f3-0b8f1871f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeee4d6c-59cd-44a9-86f3-0b8f1871f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-711056820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66fa096-cf1b-478c-93f1-2e59f5ece031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:26Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9142e2-213b-4bb5-bd3b-3f5281034302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9142e2-213b-4bb5-bd3b-3f5281034302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd543607-f620-4f1d-87ea-8d053b4de561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd543607-f620-4f1d-87ea-8d053b4de561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66fa096-cf1b-478c-93f1-2e59f5ece031', 'volume_name': 'volume-c66fa096-cf1b-478c-93f1-2e59f5ece031', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b6cc7-589d-4c29-b64b-cca32c6c218a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147b6cc7-589d-4c29-b64b-cca32c6c218a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d591eb71-514a-4fa5-b704-cabcc43d64b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:25 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Volume c66fa096-cf1b-478c-93f1-2e59f5ece031: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66fa096-cf1b-478c-93f1-2e59f5ece031', 'volume_size': 1}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-711056820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66fa096-cf1b-478c-93f1-2e59f5ece031,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:26Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Creating volume c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:25 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:25 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:25 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 1073741824
Sep 04 06:14:25 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:26 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 1073741824" returned: 0 in 0.418s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:26 devstack sudo[107774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031
Sep 04 06:14:26 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:26 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-a1d61906-e089-4377-aa6c-0cc2213b1d28-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-a1d61906-e089-4377-aa6c-0cc2213b1d28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d591eb71-514a-4fa5-b704-cabcc43d64b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66fa096-cf1b-478c-93f1-2e59f5ece031', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6258fd9-df2a-4d5e-a3f7-becb8aa215c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-a1d61906-e089-4377-aa6c-0cc2213b1d28" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Volume volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 (c66fa096-cf1b-478c-93f1-2e59f5ece031): created successfully
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6258fd9-df2a-4d5e-a3f7-becb8aa215c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (d49d1346-c105-41bc-a6c3-396170dd3fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-a1d61906-e089-4377-aa6c-0cc2213b1d28" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot a1d61906-e089-4377-aa6c-0cc2213b1d28 of volume 9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:26 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-037c9ad3-1f4a-44a4-ab5e-adb43bbef0a0 tempest-ProjectReaderTests-1299980927 None] Created volume successfully.
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf105e93-8678-4346-946f-22650dd86deb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:26 devstack sudo[107777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28
Sep 04 06:14:26 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Creating offline snapshot ec0c17f2-514a-4e40-9cac-85d6b57f5f74 of volume c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[677ef186-64d6-439c-bbd1-a09f44c3e2b1]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28" returned: 0 in 0.388s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:27 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031
Sep 04 06:14:27 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a021d-b69b-4b29-9a44-1c1e0aaa9f58]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317
Sep 04 06:14:27 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:27 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 1G
Sep 04 06:14:27 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:27 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28
Sep 04 06:14:27 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:27 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 1G" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74
Sep 04 06:14:27 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:27 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28" returned: 0 in 0.373s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:27 devstack sudo[107804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28
Sep 04 06:14:27 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:28 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74" returned: 0 in 0.303s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 is being set with open permissions: ugo+rw
Sep 04 06:14:28 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317.a1d61906-e089-4377-aa6c-0cc2213b1d28" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:28 devstack sudo[107810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74
Sep 04 06:14:28 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-a1d61906-e089-4377-aa6c-0cc2213b1d28" released by "_delete_snapshot" :: held 1.516s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" released by "delete_snapshot" :: held 1.554s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Created reservations ['7486a120-3bb1-4f56-80ac-93b1c5f7c0e3', '3f8c9fe5-c3dc-4017-8eee-bd23dba17142', 'd75904e3-ab7f-4a98-8c99-810251b6f0d4', '8cbf1be0-4c0f-45ad-9dd9-fe2445fcd24d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39a02c2c-dd5c-4775-b464-ea7c7fccba7f tempest-ProjectMemberTests-12378103 None] Lock "cinder-a1d61906-e089-4377-aa6c-0cc2213b1d28-delete_snapshot" released by "delete_snapshot" :: held 1.701s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:28 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:28 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info
Sep 04 06:14:28 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:28 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:28 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info is being set with open permissions: ugo+rw
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:28 devstack sudo[107816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info
Sep 04 06:14:28 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-9c6289ec-3771-43b3-b2c7-4aa6b43af317-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-9c6289ec-3771-43b3-b2c7-4aa6b43af317-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" acquired by "delete_volume" :: waited 0.021s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[456073b8-6008-4ef0-960f-5ababbdf5436]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:28 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.info" returned: 0 in 0.291s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:29 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317
Sep 04 06:14:29 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4c795d73-4074-4131-a316-d7c4f88c7611 tempest-ProjectReaderTests-1299980927 None] Create snapshot completed successfully
Sep 04 06:14:29 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:29 devstack sudo[107824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317
Sep 04 06:14:29 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:29 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c6289ec-3771-43b3-b2c7-4aa6b43af317" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-9c6289ec-3771-43b3-b2c7-4aa6b43af317" released by "delete_volume" :: held 0.710s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Created reservations ['f5723974-79c3-47f5-a5bd-8371e0878a6b', 'a07e4a85-6212-42fe-98ea-e315b197102b', 'a83275b7-b564-42c0-bba7-a4d0156b1b5a', 'bd6baad1-8255-4e69-98dc-d44fd1dddf37'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:29 devstack sudo[107827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:29 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:29 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.285s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:29 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-3f87c352-4db6-40bb-a347-f2f213b1abe7 tempest-ProjectMemberTests-12378103 None] Lock "cinder-9c6289ec-3771-43b3-b2c7-4aa6b43af317-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-ec0c17f2-514a-4e40-9cac-85d6b57f5f74-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-ec0c17f2-514a-4e40-9cac-85d6b57f5f74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-ec0c17f2-514a-4e40-9cac-85d6b57f5f74" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ec0c17f2-514a-4e40-9cac-85d6b57f5f74" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Deleting offline snapshot ec0c17f2-514a-4e40-9cac-85d6b57f5f74 of volume c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] snapshot_file for this snap is: volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69f5e89-82f5-4069-b512-0e5985470686]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:30 devstack sudo[107830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74
Sep 04 06:14:30 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (de19f629-c02e-44b3-8865-19fa5736384c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59db50c-452d-442e-9721-f31b4c28f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59db50c-452d-442e-9721-f31b4c28f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525955690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21cd3f2-9da2-4505-9c89-60a48c0c2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:30Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7cc170-760b-46a5-a6b5-11e25a5dcf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7cc170-760b-46a5-a6b5-11e25a5dcf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4c41ff-6866-4ff5-b8e5-38008abee9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d4c41ff-6866-4ff5-b8e5-38008abee9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f21cd3f2-9da2-4505-9c89-60a48c0c2f54', 'volume_name': 'volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1817976c-b989-4863-8557-d60e59164a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1817976c-b989-4863-8557-d60e59164a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d884fbd-b3ee-45a6-bba7-8a18e9648632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:30 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Volume f21cd3f2-9da2-4505-9c89-60a48c0c2f54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54', 'volume_size': 1}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-525955690',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f21cd3f2-9da2-4505-9c89-60a48c0c2f54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:30Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Creating volume f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:30 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:30 devstack sudo[107835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 1073741824
Sep 04 06:14:30 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:30 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74" returned: 0 in 0.383s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c66fa096-cf1b-478c-93f1-2e59f5ece031(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e477bb88-1d4d-4796-bee9-73fd59f81755]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:30 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031
Sep 04 06:14:30 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:31 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 1073741824" returned: 0 in 0.448s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:31 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031" returned: 0 in 0.372s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:31 devstack sudo[107845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74
Sep 04 06:14:31 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:31 devstack sudo[107847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54
Sep 04 06:14:31 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:31 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d884fbd-b3ee-45a6-bba7-8a18e9648632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffcef5e-8171-41ef-ac86-a6f551c7b61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Volume volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 (f21cd3f2-9da2-4505-9c89-60a48c0c2f54): created successfully
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffcef5e-8171-41ef-ac86-a6f551c7b61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (de19f629-c02e-44b3-8865-19fa5736384c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:31 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-320ce23d-6543-4ad8-859f-2de76002f1b8 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74" returned: 0 in 0.360s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:31 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74
Sep 04 06:14:31 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:31 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031.ec0c17f2-514a-4e40-9cac-85d6b57f5f74" returned: 0 in 0.280s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Creating offline snapshot bbe53f64-f82e-4188-9583-77d02cdc26e6 of volume f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-ec0c17f2-514a-4e40-9cac-85d6b57f5f74" released by "_delete_snapshot" :: held 1.509s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" released by "delete_snapshot" :: held 1.529s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d267dd66-4c6a-4954-8cf4-c4fd74c17d6c]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Created reservations ['0e235b26-2dc7-4255-96d1-a62be483b0e3', '82c6a2c6-1604-4c31-a4e8-3e7b1deb10c7', '8a94fd7d-d6b2-409a-b2ad-1760f60a0cf8', '04f4a5b1-2cb3-466b-a838-29a876669e65'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:31 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54
Sep 04 06:14:31 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Delete snapshot completed successfully.
Sep 04 06:14:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-808f1a03-18ee-4880-bfa3-47b84c4817f4 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-ec0c17f2-514a-4e40-9cac-85d6b57f5f74-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:32 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" returned: 0 in 0.376s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:32 devstack sudo[107862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 1G
Sep 04 06:14:32 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-c66fa096-cf1b-478c-93f1-2e59f5ece031-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-c66fa096-cf1b-478c-93f1-2e59f5ece031-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" acquired by "delete_volume" :: waited 0.016s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[d085d5af-0585-44a4-b1ce-76a9fffe51ad]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:32 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 1G" returned: 0 in 0.453s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:32 devstack sudo[107867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031
Sep 04 06:14:32 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:32 devstack sudo[107868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6
Sep 04 06:14:32 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:32 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:32 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:32 devstack sudo[107877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031
Sep 04 06:14:32 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6" returned: 0 in 0.305s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:32 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 is being set with open permissions: ugo+rw
Sep 04 06:14:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:32 devstack sudo[107879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6
Sep 04 06:14:32 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:33 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-c66fa096-cf1b-478c-93f1-2e59f5ece031" returned: 0 in 0.265s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:33 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-c66fa096-cf1b-478c-93f1-2e59f5ece031" released by "delete_volume" :: held 0.704s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:33 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info
Sep 04 06:14:33 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Created reservations ['2b937591-7d33-4875-aae5-f16dcd369c15', '85eb9308-cb50-460c-bfa0-6eee79afd723', '633f68e5-86d3-419c-9dbc-a3441d4012c4', '914d4f08-7cad-4666-8b05-026f84ccbf06'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:33 devstack sudo[107885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:33 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:33 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info" returned: 0 in 0.274s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:33 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info is being set with open permissions: ugo+rw
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:33 devstack sudo[107888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info
Sep 04 06:14:33 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:33 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.292s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Deleted volume successfully.
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-ee2857ac-d638-4e51-b17c-3b80934ae569 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-c66fa096-cf1b-478c-93f1-2e59f5ece031-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:33 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.info" returned: 0 in 0.282s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.064s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a91246b9-5533-4bb7-9147-66a13eb111f4 tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (15fdfe90-8b38-49cd-a15a-c67ffdda3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1841ae-61ad-44c4-9c5e-ec2a3dc11b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1841ae-61ad-44c4-9c5e-ec2a3dc11b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880213406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b4d278-da5a-4224-92f7-96a0ba38db13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:34Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406e91a4-b21f-41b2-907e-699add92c29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406e91a4-b21f-41b2-907e-699add92c29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd452b6-286b-4250-99e2-b4becdf95408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:33 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd452b6-286b-4250-99e2-b4becdf95408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65b4d278-da5a-4224-92f7-96a0ba38db13', 'volume_name': 'volume-65b4d278-da5a-4224-92f7-96a0ba38db13', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e579850-616a-4a39-b827-0f811c5e1d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e579850-616a-4a39-b827-0f811c5e1d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffba628f-46cf-4051-b8ba-14ad3f6d8db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Volume 65b4d278-da5a-4224-92f7-96a0ba38db13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65b4d278-da5a-4224-92f7-96a0ba38db13', 'volume_size': 1}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880213406',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65b4d278-da5a-4224-92f7-96a0ba38db13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:34Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Creating volume 65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:34 devstack sudo[107893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 1073741824
Sep 04 06:14:34 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:34 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 1073741824" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:34 devstack sudo[107899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13
Sep 04 06:14:34 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13" returned: 0 in 0.240s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:34 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffba628f-46cf-4051-b8ba-14ad3f6d8db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65b4d278-da5a-4224-92f7-96a0ba38db13', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0e9d01-69f7-4121-b193-6bd11ffd8ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Volume volume-65b4d278-da5a-4224-92f7-96a0ba38db13 (65b4d278-da5a-4224-92f7-96a0ba38db13): created successfully
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0e9d01-69f7-4121-b193-6bd11ffd8ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (15fdfe90-8b38-49cd-a15a-c67ffdda3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:34 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-75ab9d06-894f-4d5d-a1e0-06bb26735703 tempest-ProjectReaderTests-1299980927 None] Created volume successfully.
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-bbe53f64-f82e-4188-9583-77d02cdc26e6-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-bbe53f64-f82e-4188-9583-77d02cdc26e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-bbe53f64-f82e-4188-9583-77d02cdc26e6" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-bbe53f64-f82e-4188-9583-77d02cdc26e6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot bbe53f64-f82e-4188-9583-77d02cdc26e6 of volume f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27f00c4-6446-4330-9deb-a88f5e627354]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:35 devstack sudo[107902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6
Sep 04 06:14:35 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Creating offline snapshot faf386fa-d45c-405c-a2a6-ce70b7551dc9 of volume 65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[56083b8a-fe69-4d2d-82a1-b91fe6eb710a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:35 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13
Sep 04 06:14:35 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:35 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f5f80-6aa5-4947-a323-6ce8d873996f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:35 devstack sudo[107909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54
Sep 04 06:14:35 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:35 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13" returned: 0 in 0.409s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:35 devstack sudo[107914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 1G
Sep 04 06:14:35 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:35 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" returned: 0 in 0.380s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:35 devstack sudo[107919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6
Sep 04 06:14:35 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:36 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 1G" returned: 0 in 0.441s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65b4d278-da5a-4224-92f7-96a0ba38db13 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:36 devstack sudo[107927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65b4d278-da5a-4224-92f7-96a0ba38db13 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9
Sep 04 06:14:36 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:36 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:36 devstack sudo[107929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6
Sep 04 06:14:36 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:36 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54.bbe53f64-f82e-4188-9583-77d02cdc26e6" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:36 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65b4d278-da5a-4224-92f7-96a0ba38db13 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9" returned: 0 in 0.358s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:36 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 is being set with open permissions: ugo+rw
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-bbe53f64-f82e-4188-9583-77d02cdc26e6" released by "_delete_snapshot" :: held 1.539s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" released by "delete_snapshot" :: held 1.565s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:36 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9
Sep 04 06:14:36 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Created reservations ['d0bc83ec-4cfb-481c-8004-978a24dc8d0b', '24e72835-2e0f-40e6-9106-dbad4d82b649', '938802f9-4afb-4dc6-85c3-972e91cedcb8', 'ed6870c8-e335-486b-b4c0-cf2ee1b8fc88'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-641ae7c9-9635-4bf9-a62e-89dfab785652 tempest-ProjectMemberTests-12378103 None] Lock "cinder-bbe53f64-f82e-4188-9583-77d02cdc26e6-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:36 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:36 devstack sudo[107938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info
Sep 04 06:14:36 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:36 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-f21cd3f2-9da2-4505-9c89-60a48c0c2f54-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:37 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info is being set with open permissions: ugo+rw
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "cinder-f21cd3f2-9da2-4505-9c89-60a48c0c2f54-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:37 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info
Sep 04 06:14:37 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=182,cinder:INSERT=69,cinder:UPDATE=231,cinder:DELETE=19 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=193,cinder:INSERT=60,cinder:UPDATE=238,cinder:DELETE=19 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" acquired by "delete_volume" :: waited 0.024s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[076e0be7-8bdf-4525-b580-882b166494db]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:37 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.info" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:37 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54
Sep 04 06:14:37 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:37 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2f13ecf3-c55b-4101-bd57-3cf5f5667a5a tempest-ProjectReaderTests-1299980927 None] Create snapshot completed successfully
Sep 04 06:14:37 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" returned: 0 in 0.419s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:37 devstack sudo[107950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54
Sep 04 06:14:37 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:37 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" returned: 0 in 0.256s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-f21cd3f2-9da2-4505-9c89-60a48c0c2f54" released by "delete_volume" :: held 0.737s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Created reservations ['dc2fde2f-1bda-407a-8a6d-80ec5a46238d', '8443e5d4-422b-474f-8b08-7709bc1b85b5', '1c55100c-7b8d-4884-88dc-3f3ee2223991', '7bfc807d-6fbe-4edd-a838-69ba5aba761b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:37 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:38 devstack sudo[107953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:38 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:38 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.298s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:38 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-1413849f-b917-4f1b-aebe-c5dff2d3bd3b tempest-ProjectMemberTests-12378103 None] Lock "cinder-f21cd3f2-9da2-4505-9c89-60a48c0c2f54-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-faf386fa-d45c-405c-a2a6-ce70b7551dc9-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-faf386fa-d45c-405c-a2a6-ce70b7551dc9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-faf386fa-d45c-405c-a2a6-ce70b7551dc9" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-faf386fa-d45c-405c-a2a6-ce70b7551dc9" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Deleting offline snapshot faf386fa-d45c-405c-a2a6-ce70b7551dc9 of volume 65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] snapshot_file for this snap is: volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40e9d89-79c1-4a86-b3f8-f171f259bfb2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:38 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9
Sep 04 06:14:38 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (c277f33c-766a-43e9-9b2d-ad79c7015635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb3c312-1fce-422e-894c-a1f27dc38f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bb3c312-1fce-422e-894c-a1f27dc38f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133450181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5042a886-9006-46ee-b54e-a2bdcded26a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:39Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a56172-7ba7-429d-ae24-1266b25fbf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2a56172-7ba7-429d-ae24-1266b25fbf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe4b13f-cefd-4f60-b2da-d51e618193fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe4b13f-cefd-4f60-b2da-d51e618193fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5042a886-9006-46ee-b54e-a2bdcded26a1', 'volume_name': 'volume-5042a886-9006-46ee-b54e-a2bdcded26a1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c83be84-67ee-4dff-a94f-ebe14c3f0097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c83be84-67ee-4dff-a94f-ebe14c3f0097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008aeb11-ed09-49c1-a8d4-76bf19067ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:38 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Volume 5042a886-9006-46ee-b54e-a2bdcded26a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5042a886-9006-46ee-b54e-a2bdcded26a1', 'volume_size': 1}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133450181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5042a886-9006-46ee-b54e-a2bdcded26a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:39Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Creating volume 5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:38 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:38 devstack sudo[107975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 1073741824
Sep 04 06:14:38 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:38 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9" returned: 0 in 0.405s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65b4d278-da5a-4224-92f7-96a0ba38db13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2f6c2-b529-4ead-8a67-c2daaa06161b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:38 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:39 devstack sudo[107997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13
Sep 04 06:14:39 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:39 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 1073741824" returned: 0 in 0.436s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:39 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:39 devstack sudo[108009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13" returned: 0 in 0.415s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:39 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:39 devstack sudo[108011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9
Sep 04 06:14:39 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:39 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1" returned: 0 in 0.271s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (008aeb11-ed09-49c1-a8d4-76bf19067ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5042a886-9006-46ee-b54e-a2bdcded26a1', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7667ac0-01b2-4a77-91c1-0d28047e8d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:39 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Volume volume-5042a886-9006-46ee-b54e-a2bdcded26a1 (5042a886-9006-46ee-b54e-a2bdcded26a1): created successfully
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7667ac0-01b2-4a77-91c1-0d28047e8d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (c277f33c-766a-43e9-9b2d-ad79c7015635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:39 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-cc92fe63-30e2-4546-8d4f-95860b34ecf4 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:39 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9" returned: 0 in 0.365s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:39 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9
Sep 04 06:14:39 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Creating offline snapshot cf668963-1f9e-4485-8554-157f39ba8690 of volume 5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7981af8-62e0-415d-ba06-ade15bd9d905]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:39 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:40 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13.faf386fa-d45c-405c-a2a6-ce70b7551dc9" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-faf386fa-d45c-405c-a2a6-ce70b7551dc9" released by "_delete_snapshot" :: held 1.611s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" released by "delete_snapshot" :: held 1.639s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:40 devstack sudo[108021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1
Sep 04 06:14:40 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Created reservations ['e654cce5-4099-4914-b7dc-4153fc99eb46', 'ebc7a6ad-cf25-4ac5-88db-b3ed72fba4d0', '36d2931d-0488-4157-aa2c-80e142b0ce5c', '5c5601de-985f-4b34-8e2d-e23778dd8a1b'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:40 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Delete snapshot completed successfully.
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c61e4736-7bdd-48de-a679-d5cb55525448 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-faf386fa-d45c-405c-a2a6-ce70b7551dc9-delete_snapshot" released by "delete_snapshot" :: held 1.784s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:40 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1" returned: 0 in 0.412s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:40 devstack sudo[108026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 1G
Sep 04 06:14:40 devstack sudo[108026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-65b4d278-da5a-4224-92f7-96a0ba38db13-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-65b4d278-da5a-4224-92f7-96a0ba38db13-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[649c8ff3-b476-4a81-94b6-44e35c868610]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:40 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13
Sep 04 06:14:40 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:40 devstack sudo[108026]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 1G" returned: 0 in 0.420s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:40 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5042a886-9006-46ee-b54e-a2bdcded26a1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:40 devstack sudo[108034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5042a886-9006-46ee-b54e-a2bdcded26a1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690
Sep 04 06:14:40 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13" returned: 0 in 0.381s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:41 devstack sudo[108042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13
Sep 04 06:14:41 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5042a886-9006-46ee-b54e-a2bdcded26a1 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 is being set with open permissions: ugo+rw
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:41 devstack sudo[108045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690
Sep 04 06:14:41 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-65b4d278-da5a-4224-92f7-96a0ba38db13" returned: 0 in 0.266s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-65b4d278-da5a-4224-92f7-96a0ba38db13" released by "delete_volume" :: held 0.715s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:41 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Created reservations ['f32c6501-e865-41fa-a190-bd31a9f34dcc', 'e9307028-9051-497d-a3ba-9472d6bc9fa3', 'a8d36943-0a65-4fa3-abbb-374db33f5f63', '4895e74c-a154-4808-8c19-ed3843f41cba'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690" returned: 0 in 0.286s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:41 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info
Sep 04 06:14:41 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:41 devstack sudo[108052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:41 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info" returned: 0 in 0.287s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info is being set with open permissions: ugo+rw
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:41 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:41 devstack sudo[108056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:41 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:41 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Deleted volume successfully.
Sep 04 06:14:41 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7d53c501-5f42-4cca-a431-abf07343706e tempest-ProjectReaderTests-1299980927 None] Lock "cinder-65b4d278-da5a-4224-92f7-96a0ba38db13-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:42 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.info" returned: 0 in 0.295s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:42 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0c85cb9f-a340-4e28-a99b-fab964032d13 tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (26eb673b-6fc6-4308-a74a-4b2909e487bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d18ab4-8c62-48c8-95a6-bd5a398fb086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d18ab4-8c62-48c8-95a6-bd5a398fb086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761931256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:42Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96436596-76fc-4673-a03a-751724c3aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96436596-76fc-4673-a03a-751724c3aa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ef260f-4a00-430c-9a70-a0b3d293b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ef260f-4a00-430c-9a70-a0b3d293b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96', 'volume_name': 'volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1810afe5-4642-41f2-af31-14cdb80d4519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1810afe5-4642-41f2-af31-14cdb80d4519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d8c7f8-4b20-4893-9dd6-b92c0b5fe5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:42 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Volume 5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96', 'volume_size': 1}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761931256',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecb728d4d780476b9d7fb971fb7e2476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:42Z,use_quota=True,user_id='53a726d2dfcc42d2a2640d6e28027853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Creating volume 5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:42 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:42 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 1073741824
Sep 04 06:14:42 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:42 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 1073741824" returned: 0 in 0.443s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:42 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:42 devstack sudo[108064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96
Sep 04 06:14:42 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:43 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" returned: 0 in 0.246s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06d8c7f8-4b20-4893-9dd6-b92c0b5fe5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85432e6-d5ae-4ff4-a941-3286fc72b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:43 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Volume volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 (5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96): created successfully
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85432e6-d5ae-4ff4-a941-3286fc72b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Flow 'volume_create_manager' (26eb673b-6fc6-4308-a74a-4b2909e487bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:43 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-2392a35d-f4b4-4682-b426-d48e2ed7b0f7 tempest-ProjectReaderTests-1299980927 None] Created volume successfully.
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-cf668963-1f9e-4485-8554-157f39ba8690-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-cf668963-1f9e-4485-8554-157f39ba8690-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-cf668963-1f9e-4485-8554-157f39ba8690" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-cf668963-1f9e-4485-8554-157f39ba8690" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot cf668963-1f9e-4485-8554-157f39ba8690 of volume 5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[577cd1b8-eef5-49d6-84da-c47913f75d06]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:43 devstack sudo[108067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690
Sep 04 06:14:43 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Creating offline snapshot 41db6d8e-acb8-4170-937e-529d2c65acaa of volume 5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a3d85-6e6d-4c38-8155-6ee4a5dc60a2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:43 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:43 devstack sudo[108069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690" returned: 0 in 0.375s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:43 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5042a886-9006-46ee-b54e-a2bdcded26a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35672a-ad65-4dc9-944d-ab5664766095]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:43 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1
Sep 04 06:14:43 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:43 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:43 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:43 devstack sudo[108079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa 1G
Sep 04 06:14:43 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:43 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1" returned: 0 in 0.366s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:44 devstack sudo[108084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690
Sep 04 06:14:44 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:44 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa 1G" returned: 0 in 0.413s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:44 devstack sudo[108092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa
Sep 04 06:14:44 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:44 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690" returned: 0 in 0.396s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:44 devstack sudo[108095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690
Sep 04 06:14:44 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:44 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa" returned: 0 in 0.306s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa is being set with open permissions: ugo+rw
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:44 devstack sudo[108100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa
Sep 04 06:14:44 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:44 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1.cf668963-1f9e-4485-8554-157f39ba8690" returned: 0 in 0.264s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-cf668963-1f9e-4485-8554-157f39ba8690" released by "_delete_snapshot" :: held 1.513s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" released by "delete_snapshot" :: held 1.541s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Created reservations ['41f68c0b-02c9-4708-8d29-3365d2676df5', 'dcb148cb-544f-4299-8bd4-6aeee5e69ae7', '55b0a565-2113-44d7-b0b9-60207b0d73d8', 'e80df422-d5ec-4d56-b755-bcd27b1347ef'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:44 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-39ced88d-5e67-41b3-af2c-4f98c30ddde5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-cf668963-1f9e-4485-8554-157f39ba8690-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:44 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa" returned: 0 in 0.260s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:44 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:44 devstack sudo[108104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info
Sep 04 06:14:44 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:45 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info" returned: 0 in 0.254s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:45 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info is being set with open permissions: ugo+rw
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:45 devstack sudo[108107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info
Sep 04 06:14:45 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-5042a886-9006-46ee-b54e-a2bdcded26a1-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "cinder-5042a886-9006-46ee-b54e-a2bdcded26a1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:45 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.info" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" acquired by "delete_volume" :: waited 0.026s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:45 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-f090558f-15e8-4e66-acc7-fee77c0bb638 tempest-ProjectReaderTests-1299980927 None] Create snapshot completed successfully
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[85815cc6-c27c-46aa-b1e7-0a3d9c77c89a]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:45 devstack sudo[108110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1
Sep 04 06:14:45 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:45 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1" returned: 0 in 0.393s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:45 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:45 devstack sudo[108115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1
Sep 04 06:14:45 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:46 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5042a886-9006-46ee-b54e-a2bdcded26a1" returned: 0 in 0.255s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-5042a886-9006-46ee-b54e-a2bdcded26a1" released by "delete_volume" :: held 0.715s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Created reservations ['59f90874-0e77-44c5-9ec2-af5fd6798c95', '854333ad-670d-49dc-b5e0-925d1322cc8e', 'b404b950-9941-4545-b88e-e3de374181a9', '1d051909-f9af-40c7-b91e-5ba96958947a'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:46 devstack sudo[108118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:46 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:46 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.293s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:46 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-bca2c1bb-0aeb-415a-9dbe-8bdd02725be9 tempest-ProjectMemberTests-12378103 None] Lock "cinder-5042a886-9006-46ee-b54e-a2bdcded26a1-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-41db6d8e-acb8-4170-937e-529d2c65acaa-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-41db6d8e-acb8-4170-937e-529d2c65acaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-41db6d8e-acb8-4170-937e-529d2c65acaa" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-41db6d8e-acb8-4170-937e-529d2c65acaa" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Deleting offline snapshot 41db6d8e-acb8-4170-937e-529d2c65acaa of volume 5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] snapshot_file for this snap is: volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27bd86d-3607-4892-83a4-2e21ec6ea493]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:46 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:46 devstack sudo[108121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa
Sep 04 06:14:46 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (c94b2044-8e99-4fce-9d18-5271893fbfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9450bf-4b0e-4426-8716-e2ed2776e65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd9450bf-4b0e-4426-8716-e2ed2776e65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554045083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f8fdbd-83dc-4e52-af75-bc66f46d26ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:47Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa713ef-a94b-4fa9-8e39-8225ac2c96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daa713ef-a94b-4fa9-8e39-8225ac2c96d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f4591c-3a73-44db-a526-b52d40a6682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f4591c-3a73-44db-a526-b52d40a6682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f8fdbd-83dc-4e52-af75-bc66f46d26ae', 'volume_name': 'volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f521cc1-4c4b-4c61-b411-bcf799f2e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f521cc1-4c4b-4c61-b411-bcf799f2e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5124b-4a4a-45be-8f96-88dd1b58e4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Volume 31f8fdbd-83dc-4e52-af75-bc66f46d26ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae', 'volume_size': 1}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-554045083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f8fdbd-83dc-4e52-af75-bc66f46d26ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:47Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Creating volume 31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:47 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:47 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa" returned: 0 in 0.408s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:47 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae 1073741824
Sep 04 06:14:47 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6d2828-16ff-4d78-b172-3032924559db]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:47 devstack sudo[108129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96
Sep 04 06:14:47 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" returned: 0 in 0.406s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:47 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae 1073741824" returned: 0 in 0.481s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:47 devstack sudo[108137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa
Sep 04 06:14:47 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:47 devstack sudo[108139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae
Sep 04 06:14:47 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:47 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18b5124b-4a4a-45be-8f96-88dd1b58e4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4456034-9490-4ab2-a0fd-2dbd277ddc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa" returned: 0 in 0.333s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:47 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Volume volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae (31f8fdbd-83dc-4e52-af75-bc66f46d26ae): created successfully
Sep 04 06:14:47 devstack sudo[108145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa
Sep 04 06:14:47 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4456034-9490-4ab2-a0fd-2dbd277ddc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:47 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (c94b2044-8e99-4fce-9d18-5271893fbfeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:47 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-860bf50f-b55a-4b5a-9506-89f06692d2a1 tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:48 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96.41db6d8e-acb8-4170-937e-529d2c65acaa" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-41db6d8e-acb8-4170-937e-529d2c65acaa" released by "_delete_snapshot" :: held 1.493s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" released by "delete_snapshot" :: held 1.521s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Created reservations ['a6315494-ec7f-4ef0-9459-ea82187720da', '2f961973-cc56-4511-be63-60ca65769ff0', 'ba64a1c2-79fc-4f2a-b83b-dc39ae0a73c7', '43d64490-7985-4e53-be76-0d4732a8fa0c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:48 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Delete snapshot completed successfully.
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-29655fe8-cfc0-443c-aa70-468dc53ae682 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-41db6d8e-acb8-4170-937e-529d2c65acaa-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[845d75c7-1c21-4705-8691-a0c67e01a6e2]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:48 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:49 devstack sudo[108154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96
Sep 04 06:14:49 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Creating offline snapshot ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed of volume 31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:49 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[317f6cb1-9b89-4ef2-a548-5f71d85a1a53]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:49 devstack sudo[108160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96
Sep 04 06:14:49 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:49 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae
Sep 04 06:14:49 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:49 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" returned: 0 in 0.277s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-quobyte-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96" released by "delete_volume" :: held 0.730s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Created reservations ['8570f290-28aa-4b24-9f4c-33bbaba3db17', 'd5120439-cf38-4ca4-b6ea-054483a0b9ef', '9e812d58-de1b-4064-a16b-3648e0244ad6', '5deffe5e-1ab9-464f-a731-425d61301168'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:49 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" returned: 0 in 0.424s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:49 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:49 devstack sudo[108168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:49 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:49 devstack sudo[108169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed 1G
Sep 04 06:14:49 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:50 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.261s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:50 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Deleted volume successfully.
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-198c80f3-37c0-47bd-a664-3c53fcf37e97 tempest-ProjectReaderTests-1299980927 None] Lock "cinder-5811fc46-85d9-4fe4-a21e-aa8b2a7d3e96-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:50 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed 1G" returned: 0 in 0.522s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:50 devstack sudo[108177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed
Sep 04 06:14:50 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:50 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" returned: 0 in 0.326s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:50 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed is being set with open permissions: ugo+rw
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:50 devstack sudo[108182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed
Sep 04 06:14:50 devstack sudo[108182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:50 devstack sudo[108182]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" returned: 0 in 0.283s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:50 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:50 devstack sudo[108185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info
Sep 04 06:14:50 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:51 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info" returned: 0 in 0.299s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:51 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info is being set with open permissions: ugo+rw
Sep 04 06:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:51 devstack sudo[108189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info
Sep 04 06:14:51 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:51 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.info" returned: 0 in 0.275s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:51 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.234s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:51 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-4f6f163d-6d5e-4aa0-baf4-815969703ac3 tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed of volume 31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35dba8f-a4ac-4adc-80c7-724bd564d3ce]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:52 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:52 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed
Sep 04 06:14:52 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:53 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" returned: 0 in 0.410s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b397b8-b079-4c47-805e-e52c966f9db4]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:53 devstack sudo[108197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae
Sep 04 06:14:53 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:53 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" returned: 0 in 0.434s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:53 devstack sudo[108202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed
Sep 04 06:14:53 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:53 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:53 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:53 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed
Sep 04 06:14:53 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:54 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae.ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" returned: 0 in 0.290s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed" released by "_delete_snapshot" :: held 1.679s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" released by "delete_snapshot" :: held 1.707s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Created reservations ['9c24b336-110b-48a4-baeb-89ef4ce3a99c', '83e8592a-c5de-425e-a380-3fa4ef6ea554', '6905bc24-6380-47f2-acca-3fd09306643a', '2929da17-ec71-4962-8c93-675f8cecf8d3'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:54 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-7af98ce4-ea35-4c94-acd1-49fad2dbac72 tempest-ProjectMemberTests-12378103 None] Lock "cinder-ca1b17b0-166a-4b6b-b56a-ffc7ea5572ed-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-31f8fdbd-83dc-4e52-af75-bc66f46d26ae-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "cinder-31f8fdbd-83dc-4e52-af75-bc66f46d26ae-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77aa39a-8fd9-468b-8653-f32473d348ca]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:54 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:54 devstack sudo[108210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae
Sep 04 06:14:54 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:55 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:55 devstack sudo[108215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae
Sep 04 06:14:55 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:55 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-31f8fdbd-83dc-4e52-af75-bc66f46d26ae" released by "delete_volume" :: held 0.738s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Created reservations ['37761c87-8d45-40b1-bb04-2df2fc05b32b', '29b14a7f-501a-4292-af6a-45639f9ac96c', '0ddaba63-7221-4892-95df-d35bac20adf3', '3ff077ea-8eb7-46ea-a01d-9cb2a81bc5a4'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:55 devstack sudo[108218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:14:55 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:55 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.288s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:14:55 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:14:55 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-26dedddf-093a-4821-a7b1-a0d777db3bd6 tempest-ProjectMemberTests-12378103 None] Lock "cinder-31f8fdbd-83dc-4e52-af75-bc66f46d26ae-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (233a1a67-1bc6-4451-8ac8-72470dd9cd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1e1dc1-b46c-4ba1-9439-dab70447a949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1e1dc1-b46c-4ba1-9439-dab70447a949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129460907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12770d0d-49ca-42fb-a239-32a0dfe6aa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:56Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e685dd-1b73-4a8d-8f08-45890cb5ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e685dd-1b73-4a8d-8f08-45890cb5ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6095b0-3270-4a91-8d38-30b06b337261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f6095b0-3270-4a91-8d38-30b06b337261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12770d0d-49ca-42fb-a239-32a0dfe6aa90', 'volume_name': 'volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc5baf1-ac4d-48e7-b7fa-2624c80c30ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc5baf1-ac4d-48e7-b7fa-2624c80c30ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb4d352-b231-4a21-ba50-aed876befdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:56 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Volume 12770d0d-49ca-42fb-a239-32a0dfe6aa90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90', 'volume_size': 1}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2129460907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12770d0d-49ca-42fb-a239-32a0dfe6aa90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0ee9c5c793c429ab602a96fdcf768fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:14:56Z,use_quota=True,user_id='80bf8dd3542644288c910bf343ac0777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Creating volume 12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:14:56 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:14:56 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:56 devstack sudo[108221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 1073741824
Sep 04 06:14:56 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:57 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 1073741824" returned: 0 in 0.449s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:57 devstack sudo[108226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90
Sep 04 06:14:57 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:57 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90" returned: 0 in 0.301s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eb4d352-b231-4a21-ba50-aed876befdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4b73b2-9496-4727-84f8-32dc27933f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:14:57 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Volume volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 (12770d0d-49ca-42fb-a239-32a0dfe6aa90): created successfully
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4b73b2-9496-4727-84f8-32dc27933f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:14:57 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Flow 'volume_create_manager' (233a1a67-1bc6-4451-8ac8-72470dd9cd25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:14:57 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-d96e1a2b-51ba-4ecf-9b04-a16694c17fff tempest-ProjectMemberTests-12378103 None] Created volume successfully.
Sep 04 06:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:14:58 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Creating offline snapshot 3509c79c-9d31-413f-9d32-3f9994b15602 of volume 12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Sep 04 06:14:58 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[804886de-a7cc-4a3f-b6a6-4a89b43d403b]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:14:58 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:58 devstack sudo[108229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90
Sep 04 06:14:58 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:59 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90" returned: 0 in 0.386s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 1G {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:59 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 1G
Sep 04 06:14:59 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:59 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 1G" returned: 0 in 0.470s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:59 devstack sudo[108240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602
Sep 04 06:14:59 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:14:59 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 -F qcow2 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602" returned: 0 in 0.327s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:14:59 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 is being set with open permissions: ugo+rw
Sep 04 06:14:59 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:14:59 devstack sudo[108245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602
Sep 04 06:14:59 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:00 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602" returned: 0 in 0.253s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:00 devstack sudo[108248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info
Sep 04 06:15:00 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:00 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info" returned: 0 in 0.259s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:00 devstack cinder-volume[87095]: WARNING cinder.volume.drivers.remotefs [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info is being set with open permissions: ugo+rw
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:00 devstack sudo[108251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info
Sep 04 06:15:00 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:00 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.info" returned: 0 in 0.244s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:00 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.046s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:00 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46dfe0d9-c600-45ea-b64e-ff8946daa897 tempest-ProjectMemberTests-12378103 None] Create snapshot completed successfully
Sep 04 06:15:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-3509c79c-9d31-413f-9d32-3f9994b15602-delete_snapshot" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-3509c79c-9d31-413f-9d32-3f9994b15602-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" by "delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:01 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-3509c79c-9d31-413f-9d32-3f9994b15602" by "_delete_snapshot" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-3509c79c-9d31-413f-9d32-3f9994b15602" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Deleting offline snapshot 3509c79c-9d31-413f-9d32-3f9994b15602 of volume 12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] snapshot_file for this snap is: volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea60de5c-8107-47d6-855f-018e538376bb]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:02 devstack sudo[108258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602
Sep 04 06:15:02 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:02 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602" returned: 0 in 0.399s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87095) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aac001b-158d-41fe-933a-8787036f0812]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:02 devstack sudo[108263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90
Sep 04 06:15:02 devstack sudo[108263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:02 devstack sudo[108263]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90" returned: 0 in 0.404s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:02 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:02 devstack sudo[108268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602
Sep 04 06:15:02 devstack sudo[108268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:03 devstack sudo[108268]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602" returned: 0 in 0.353s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:03 devstack sudo[108273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602
Sep 04 06:15:03 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:03 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90.3509c79c-9d31-413f-9d32-3f9994b15602" returned: 0 in 0.279s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-3509c79c-9d31-413f-9d32-3f9994b15602" released by "_delete_snapshot" :: held 1.539s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" released by "delete_snapshot" :: held 1.566s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Created reservations ['528947d5-5519-4391-918d-99417ae5b0a9', '6c40a23a-d0ba-42ea-a01b-758504fdf5c9', 'a2257f54-697e-43ce-984e-0696a62fa92b', 'ed80b240-b7bf-4036-b679-4374e3aa3260'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:03 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Delete snapshot completed successfully.
Sep 04 06:15:03 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-0df96adc-4719-46bf-8767-cd24ad766e05 tempest-ProjectMemberTests-12378103 None] Lock "cinder-3509c79c-9d31-413f-9d32-3f9994b15602-delete_snapshot" released by "delete_snapshot" :: held 1.734s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-12770d0d-49ca-42fb-a239-32a0dfe6aa90-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-12770d0d-49ca-42fb-a239-32a0dfe6aa90-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e038bb1c-c5b3-4e30-ab5d-7c64441ff71f]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:04 devstack sudo[108276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90
Sep 04 06:15:04 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:04 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90" returned: 0 in 0.401s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:04 devstack sudo[108281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90
Sep 04 06:15:04 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:04 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-12770d0d-49ca-42fb-a239-32a0dfe6aa90" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-quobyte-12770d0d-49ca-42fb-a239-32a0dfe6aa90" released by "delete_volume" :: held 0.723s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:04 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Created reservations ['767f5482-2732-4ce3-8456-408c480f9f53', '6e138071-3ee0-458e-b4f7-89b503bb3b1c', 'c2b1ae2b-32eb-4e34-afd9-4c32d4908d72', 'a90b10d9-8f24-40e9-9bdf-38615d6a76ae'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:05 devstack sudo[108284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:05 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:05 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.272s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:05 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Deleted volume successfully.
Sep 04 06:15:05 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-994e3809-a8e9-4882-b720-515b7c000ae5 tempest-ProjectMemberTests-12378103 None] Lock "cinder-12770d0d-49ca-42fb-a239-32a0dfe6aa90-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-93106c56-e585-497f-aa1d-51109810832f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:12 devstack sudo[108291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:12 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:12 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-93106c56-e585-497f-aa1d-51109810832f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG oslo_service.periodic_task [None req-93106c56-e585-497f-aa1d-51109810832f None None] Running periodic task VolumeManager._thread_info {{(pid=87095) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread count: 29 {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Sep 04 06:15:12 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-93106c56-e585-497f-aa1d-51109810832f None None] thread info: [<_MainThread(MainThread, started 126582081978496)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 126581968188416)>, <Thread(Thread-3 (stat_writer), started daemon 126581966701184)>, <Thread(Rabbit-heartbeat, started daemon 126581967449088)>, <Thread(Thread-5 (_runner), started daemon 126581965503168)>, <Thread(Thread-7 (_runner), started daemon 126581965545088)>, <Thread(fd_logger, started daemon 126581961314688)>, <Thread(privsep_reader, started daemon 126581964969472)>, <Thread(Rabbit-heartbeat, started daemon 126581959668032)>, <Thread(tpool_thread_0, started daemon 126581955954368)>, <Thread(tpool_thread_1, started daemon 126581947561664)>, <Thread(tpool_thread_2, started daemon 126581939168960)>, <Thread(tpool_thread_3, started daemon 126581930776256)>, <Thread(tpool_thread_4, started daemon 126581922383552)>, <Thread(tpool_thread_5, started daemon 126581913990848)>, <Thread(tpool_thread_6, started daemon 126581905598144)>, <Thread(tpool_thread_7, started daemon 126581897205440)>, <Thread(tpool_thread_8, started daemon 126581888812736)>, <Thread(tpool_thread_9, started daemon 126581880420032)>, <Thread(tpool_thread_10, started daemon 126581872027328)>, <Thread(tpool_thread_11, started daemon 126581863634624)>, <Thread(tpool_thread_12, started daemon 126581855241920)>, <Thread(tpool_thread_13, started daemon 126581846849216)>, <Thread(tpool_thread_14, started daemon 126581838440128)>, <Thread(tpool_thread_15, started daemon 126581830031040)>, <Thread(tpool_thread_16, started daemon 126581821621952)>, <Thread(tpool_thread_17, started daemon 126581813212864)>, <Thread(tpool_thread_18, started daemon 126581804803776)>, <Thread(tpool_thread_19, started daemon 126581796394688)>] {{(pid=87095) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Sep 04 06:15:15 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=69,cinder:UPDATE=94,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:15:22 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=73,cinder:DELETE=8,cinder:INSERT=36,cinder:UPDATE=94 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (8b1ae05b-832a-40b7-9c3b-f12cae8bdab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92af1878-9288-4dad-9265-c75878bf22a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92af1878-9288-4dad-9265-c75878bf22a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934450237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d961c27-08c6-4eee-9e98-a767557289de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:26Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2999a4c-5225-4c77-9870-537ae5cdb77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2999a4c-5225-4c77-9870-537ae5cdb77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485e079f-2913-41aa-999f-0be71813fb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485e079f-2913-41aa-999f-0be71813fb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d961c27-08c6-4eee-9e98-a767557289de', 'volume_name': 'volume-9d961c27-08c6-4eee-9e98-a767557289de', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7871b58f-4c31-45de-9678-9735867b234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7871b58f-4c31-45de-9678-9735867b234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf8a6df-2035-4006-af0f-997b1fca21d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Volume 9d961c27-08c6-4eee-9e98-a767557289de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d961c27-08c6-4eee-9e98-a767557289de', 'volume_size': 1}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1934450237',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d961c27-08c6-4eee-9e98-a767557289de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:26Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Creating volume 9d961c27-08c6-4eee-9e98-a767557289de {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:15:26 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:26 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de 1073741824
Sep 04 06:15:26 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:26 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de 1073741824" returned: 0 in 0.442s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:26 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de
Sep 04 06:15:26 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:26 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de" returned: 0 in 0.250s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf8a6df-2035-4006-af0f-997b1fca21d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d961c27-08c6-4eee-9e98-a767557289de', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d9be08-39ca-4008-8fa2-f08075c5c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:26 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Volume volume-9d961c27-08c6-4eee-9e98-a767557289de (9d961c27-08c6-4eee-9e98-a767557289de): created successfully
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d9be08-39ca-4008-8fa2-f08075c5c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:26 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (8b1ae05b-832a-40b7-9c3b-f12cae8bdab4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:27 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-91ab63b0-2860-4e25-9ccd-9ed70ecd8f95 tempest-ProjectReaderTests-1902972616 None] Created volume successfully.
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-9d961c27-08c6-4eee-9e98-a767557289de-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-9d961c27-08c6-4eee-9e98-a767557289de-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-quobyte-9d961c27-08c6-4eee-9e98-a767557289de" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-9d961c27-08c6-4eee-9e98-a767557289de" acquired by "delete_volume" :: waited 0.018s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[e249a5de-9e0c-4b70-9b77-bce225bf60a5]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:27 devstack sudo[108305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de
Sep 04 06:15:27 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:27 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de" returned: 0 in 0.359s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:27 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:27 devstack sudo[108310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de
Sep 04 06:15:27 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:28 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9d961c27-08c6-4eee-9e98-a767557289de" returned: 0 in 0.243s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-9d961c27-08c6-4eee-9e98-a767557289de" released by "delete_volume" :: held 0.649s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Created reservations ['f684dd8b-a03f-48c8-8ca3-1f6e4e7a9712', 'f20cd777-2a69-4285-8816-0c2f57c2594b', '704eac5b-b234-419e-9f7d-67ecfde1f14b', '4d86ec9f-2ccd-4de5-befb-d67c16f2fdbc'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:28 devstack sudo[108313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:28 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:28 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.239s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:28 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Deleted volume successfully.
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-16ca8ce9-e806-4a74-b55b-e77f3834e5f7 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-9d961c27-08c6-4eee-9e98-a767557289de-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (0f3d2fc4-5b6c-4248-a4fb-b6a29e234271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad966e2-ad1e-4f47-adb7-67cdb88e8ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad966e2-ad1e-4f47-adb7-67cdb88e8ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551169657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbb5c87-f897-4b73-981b-dad824802f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:29Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d3fd7-fd49-495c-b4f4-86ae19412c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:28 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c0d3fd7-fd49-495c-b4f4-86ae19412c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df087e-9752-4299-9e78-af6e4eeda84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27df087e-9752-4299-9e78-af6e4eeda84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbb5c87-f897-4b73-981b-dad824802f27', 'volume_name': 'volume-3bbb5c87-f897-4b73-981b-dad824802f27', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3520fcc-9fec-4aff-8a18-e51b8df9a9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3520fcc-9fec-4aff-8a18-e51b8df9a9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e653-59e0-4a35-bae9-baeda0344341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Volume 3bbb5c87-f897-4b73-981b-dad824802f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbb5c87-f897-4b73-981b-dad824802f27', 'volume_size': 1}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551169657',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbb5c87-f897-4b73-981b-dad824802f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:29Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Creating volume 3bbb5c87-f897-4b73-981b-dad824802f27 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:15:29 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:29 devstack sudo[108316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 1073741824
Sep 04 06:15:29 devstack sudo[108316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:29 devstack sudo[108316]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 1073741824" returned: 0 in 0.425s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:29 devstack sudo[108322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27
Sep 04 06:15:29 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:29 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5e653-59e0-4a35-bae9-baeda0344341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbb5c87-f897-4b73-981b-dad824802f27', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d741e2-3aa4-4514-a9cc-46077d366df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:29 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Volume volume-3bbb5c87-f897-4b73-981b-dad824802f27 (3bbb5c87-f897-4b73-981b-dad824802f27): created successfully
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d741e2-3aa4-4514-a9cc-46077d366df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:29 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (0f3d2fc4-5b6c-4248-a4fb-b6a29e234271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:29 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-971b0a8e-d3ba-41c9-a65f-8525352f74c6 tempest-ProjectReaderTests-1902972616 None] Created volume successfully.
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-3bbb5c87-f897-4b73-981b-dad824802f27-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-3bbb5c87-f897-4b73-981b-dad824802f27-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-quobyte-3bbb5c87-f897-4b73-981b-dad824802f27" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-3bbb5c87-f897-4b73-981b-dad824802f27" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b66dd-3b89-4437-a601-c43284b40e15]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:30 devstack sudo[108325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27
Sep 04 06:15:30 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:30 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27" returned: 0 in 0.390s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:30 devstack sudo[108330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27
Sep 04 06:15:30 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:30 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-3bbb5c87-f897-4b73-981b-dad824802f27" returned: 0 in 0.252s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-3bbb5c87-f897-4b73-981b-dad824802f27" released by "delete_volume" :: held 0.681s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Created reservations ['db2f8c0e-258e-475e-9132-28172192254f', '34bab383-39dd-4892-9cc3-7c54a8132da5', 'a65300f9-31b2-4afc-af8a-21b2ce7e5348', '26734726-e949-480c-84fc-2124d4c39213'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:30 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:30 devstack sudo[108333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:30 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:31 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.258s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:31 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Deleted volume successfully.
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-c522a0e5-45b1-48e9-a978-f6b889a19a36 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-3bbb5c87-f897-4b73-981b-dad824802f27-delete_volume" released by "delete_volume" :: held 1.156s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (1038b85f-8207-46cd-881f-80f23833064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457732cb-ffe4-4fed-8f35-cfce3b6784c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457732cb-ffe4-4fed-8f35-cfce3b6784c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793703306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c277c2b-ad91-4823-9034-85d52eff853c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:32Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64565c50-f841-48db-8fc0-8defe6910add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64565c50-f841-48db-8fc0-8defe6910add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee7feb2-3095-4175-8ab7-e72c92fabbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ee7feb2-3095-4175-8ab7-e72c92fabbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c277c2b-ad91-4823-9034-85d52eff853c', 'volume_name': 'volume-9c277c2b-ad91-4823-9034-85d52eff853c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee55e65d-9df6-459e-8c3f-c7aaf4b08e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee55e65d-9df6-459e-8c3f-c7aaf4b08e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61a3ade-b13d-4f9f-b6b2-25693043e662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:31 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Volume 9c277c2b-ad91-4823-9034-85d52eff853c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c277c2b-ad91-4823-9034-85d52eff853c', 'volume_size': 1}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1793703306',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c277c2b-ad91-4823-9034-85d52eff853c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:32Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Creating volume 9c277c2b-ad91-4823-9034-85d52eff853c {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:15:31 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:15:31 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:31 devstack sudo[108337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c 1073741824
Sep 04 06:15:31 devstack sudo[108337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:32 devstack sudo[108337]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c 1073741824" returned: 0 in 0.416s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:32 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c
Sep 04 06:15:32 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:32 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c" returned: 0 in 0.263s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61a3ade-b13d-4f9f-b6b2-25693043e662) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c277c2b-ad91-4823-9034-85d52eff853c', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afc219d-a797-4006-98a2-134c466cf5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:32 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Volume volume-9c277c2b-ad91-4823-9034-85d52eff853c (9c277c2b-ad91-4823-9034-85d52eff853c): created successfully
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3afc219d-a797-4006-98a2-134c466cf5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (1038b85f-8207-46cd-881f-80f23833064f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:32 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-6d334895-85fd-4eb7-a681-4bd49147da75 tempest-ProjectReaderTests-1902972616 None] Created volume successfully.
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-9c277c2b-ad91-4823-9034-85d52eff853c-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "cinder-9c277c2b-ad91-4823-9034-85d52eff853c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-quobyte-9c277c2b-ad91-4823-9034-85d52eff853c" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-9c277c2b-ad91-4823-9034-85d52eff853c" acquired by "delete_volume" :: waited 0.013s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[07430ee9-31fc-4c98-97a2-581d5a4394a3]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:32 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:32 devstack sudo[108346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c
Sep 04 06:15:32 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:33 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c" returned: 0 in 0.361s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:33 devstack sudo[108351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c
Sep 04 06:15:33 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:33 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-9c277c2b-ad91-4823-9034-85d52eff853c" returned: 0 in 0.251s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-9c277c2b-ad91-4823-9034-85d52eff853c" released by "delete_volume" :: held 0.649s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Created reservations ['0dab9ace-2e34-4b37-85a1-dbcb52c55573', '6ccfcb19-ca2e-4324-8303-016e0d67c854', '0bd837b4-4c13-4fb0-99b3-5972edfa9202', '6e76b095-249a-4c58-bd7b-31381b050c3d'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:33 devstack sudo[108354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:33 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:33 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.237s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:33 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Deleted volume successfully.
Sep 04 06:15:33 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-46b104eb-63af-45a4-89f6-62a9a97c553d tempest-ProjectReaderTests-1902972616 None] Lock "cinder-9c277c2b-ad91-4823-9034-85d52eff853c-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87095) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (4aa382ef-bb42-4ce3-b419-b86ace3e3705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354c4b76-0e05-4d2b-b7b1-cf5945c5c83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354c4b76-0e05-4d2b-b7b1-cf5945c5c83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115063515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:34Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947a0186-a881-4349-ac66-264379a95375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947a0186-a881-4349-ac66-264379a95375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ba3388-46dc-4cf3-bbd6-a457255a7923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ba3388-46dc-4cf3-bbd6-a457255a7923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2', 'volume_name': 'volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31944f39-dd9e-4169-99a9-3e960f05111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31944f39-dd9e-4169-99a9-3e960f05111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5050f3e-56e7-4a7e-af2d-928e422c67e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:34 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Volume 7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2', 'volume_size': 1}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x732029363440>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-09-04T04:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2115063515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='742ec66011b24863a959df89abb68fd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T04:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T04:15:34Z,use_quota=True,user_id='b50e752c060c493696cea9c6821ef43f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45402435-c652-4332-959a-241d13024315),volume_type_id=45402435-c652-4332-959a-241d13024315)}" {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.remotefs [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Creating volume 7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 {{(pid=87095) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Selected osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32 as target Quobyte volume. {{(pid=87095) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Sep 04 06:15:34 devstack cinder-volume[87095]: INFO cinder.volume.drivers.remotefs [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] casted to osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 1073741824 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:34 devstack sudo[108357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 1073741824
Sep 04 06:15:34 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:34 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 1073741824" returned: 0 in 0.414s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:34 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:34 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2
Sep 04 06:15:34 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:35 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" returned: 0 in 0.245s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'} {{(pid=87095) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5050f3e-56e7-4a7e-af2d-928e422c67e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2', 'volume_size': 1}' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc13df19-c1ea-47ad-b2f2-85145c77e341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Sep 04 06:15:35 devstack cinder-volume[87095]: INFO cinder.volume.flows.manager.create_volume [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Volume volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 (7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2): created successfully
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc13df19-c1ea-47ad-b2f2-85145c77e341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87095) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Flow 'volume_create_manager' (4aa382ef-bb42-4ce3-b419-b86ace3e3705) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87095) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Sep 04 06:15:35 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-a91c81d0-31a1-4dc0-ac39-8f31970041a2 tempest-ProjectReaderTests-1902972616 None] Created volume successfully.
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2-delete_volume" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "cinder-quobyte-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" by "delete_volume" {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" acquired by "delete_volume" :: waited 0.017s {{(pid=87095) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c02b2d-636b-4e47-bec8-e393402e9114]: (4, 'qcow2') {{(pid=88806) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:35 devstack sudo[108365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2
Sep 04 06:15:35 devstack sudo[108365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:35 devstack sudo[108365]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" returned: 0 in 0.351s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:35 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:35 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2
Sep 04 06:15:35 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:36 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757/volume-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" returned: 0 in 0.248s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-quobyte-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2" released by "delete_volume" :: held 0.637s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.quota [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Created reservations ['b55a1cfc-56e7-4441-8588-19836a4cf7d6', 'b9de90d8-882e-42d8-b559-a67dc69ea199', '422251ad-bd3e-4232-a1fb-83e9b8a4c277', '1b171efa-daf9-41d4-b386-0829ca95a96c'] {{(pid=87095) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32': None} {{(pid=87095) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.volume.drivers.quobyte [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cfe07971-7754-4ef4-9704-03121831df32'] {{(pid=87095) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.lockutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87095) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757 {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Sep 04 06:15:36 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757
Sep 04 06:15:36 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 04 06:15:36 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG oslo_concurrency.processutils [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1eb879cdaf282811bfe4b92c28bdb757" returned: 0 in 0.249s {{(pid=87095) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.manager [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Notifying Schedulers of capabilities ... {{(pid=87095) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Sep 04 06:15:36 devstack cinder-volume[87095]: INFO cinder.volume.manager [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Deleted volume successfully.
Sep 04 06:15:36 devstack cinder-volume[87095]: DEBUG cinder.coordination [None req-b7148e74-ab68-45c6-8828-ecbe609f36c5 tempest-ProjectReaderTests-1902972616 None] Lock "cinder-7a95ecb6-70d2-4e95-8b5c-a9e02120c8a2-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87095) __release /opt/stack/cinder/cinder/coordination.py:152}}
Sep 04 06:15:46 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:UPDATE=48,cinder:SELECT=26,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Sep 04 06:15:46 devstack cinder-volume[87095]: DEBUG dbcounter [-] [87095] Writing DB stats cinder:SELECT=30,cinder:UPDATE=40,cinder:DELETE=4,cinder:INSERT=8 {{(pid=87095) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}